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Preface 


e 


This book presents a comprehensive treatment of signals and linear systems 
suitable for juniors and seniors in electrical engineering. The book contains most of 
the material from my earlier popular book Linear Systems and Signals (1992) with 
added chapters on analog and digital filters and digital signal processing. There 
are also additional applications to communications and controls. The sequence of 
topics in this book is somewhat different from the earlier book. Here, the Laplace 
transform follows Fourier, whereas in the 1992 book, the sequence was the exact 
opposite. Moreover, the continuous-time and the discrete-time are treated sequen- 
tially, whereas in the 1992 book, both approaches were interwoven. The book 
contains enough material in discrete-time systems so that it can be used not only 
for a traditional course in Signals and Systems, but also for an introductory course 
in Digital Signal processing. 

A perceptive author has said: “The function of a teacher is not so much to 
cover the topics of study as to uncover them for the students.” The same can be 
said of a textbook. This book, as all my previous books, emphasizes the physical 
appreciation of concepts rather than mere mathematical manipulation of symbols. 
There is a temptation to treat an engineering subject, such as this, as a branch of 
applied mathematics. This view ignores the physical meaning behind various results 
and derivations, which deprives a student of intuitive understanding of the subject. 
I have used mathematics not so much to prove an axiomatic theory as to enhance 
the physical and intuitive understanding. Wherever possible, theoretical results 
are interpreted heuristicallyt and are supported by carefully chosen examples and 
analogies.t 


Notable Features 


The notable features of the book include the following: 

1. Emphasis on intuitive and heuristic understanding of the concepts and physi- 
cal meaning of mathematical results leading to deeper appreciation and easier 
comprehension of the concepts. As one reviewer put it, “One thing I found very 
appealing about this book is great balance of mathematical and intuitive expla- 
nation.” Most reviewers of the book have noted the reader friendly character 
of the book with unusual clarity of presentation. 

2. The book provides extensive applications in the areas of communication, con- 
trols, and filtering. 

3. For those who like to get students involved with computers, computer solu- 
tions of several examples are provided using MATLAB®, which is becoming a 


{Heuristic [Greek heuriskein, to invent, discover]: a method of education in which the pupil is 
trained to find out things for himself. The word ‘Eureka’ (I have found it) is the 1st pers. perf. 
indic. act., of heuriskein. 


{f these lines appear familiar to you, there is a good reason. I have used them in the preface of 


some of my earlier books, including Signals, Systems, and Communication (Wiley, 1965). What 
is more interesting, many other authors also have borrowed them for their preface. 
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standard software package in an electrical engineering curriculum. 

4. Many students are handicapped by an inadequate background in basic material 
such as complex numbers, sinusoids, sketching signals, Cramer’s rule, partial 
fraction expansion, and matrix algebra. I have added a chapter that addresses 
these basic and pervasive topics in electrical engineering. Response by student 
has been unanimously enthusiastic. 

5. There are over 200 worked examples along with exercises (with answers) for stu- 
dents to test their understanding. There are also about 400 selected problems 
of varying difficulty at the end of the chapters. Many problems are provided 
with hints to steer a student in the proper direction. 

6. The discrete-time and continuous-time systems are covered sequentially, with 
flexibility to teach them concurrently if so desired. 

7. The summary at the end of each chapter proves helpful to students in summing 
up essential developments in the chapter, and is an effective tool in the study 
for tests. Answers to selected problems are helpful in providing feedback to 
students trying to assess their knowledge. 

8. There are several historical notes to enhance student's interest in the subject. 
These facts introduce students to historical background that influenced the 
development of electrical engineering. 


Organization 


The book opens with a chapter titled Background, which deals with the math- 
ematical background material that a student taking this course is expected to have 
already mastered. It includes topics such as complex numbers, sinusoids, sketching 
signals, Cramer’s rule, partial fraction expansion, matrix algebra. The next 7 chap- 
ters deal with continuous-time signals and systems followed by 5 chapters treating 
discrete-time signals and systems. The last chapter deals with state-space analysis. 
There are MATLAB examples dispersed throught the book. The book can be read- 
ily tailored for a variety of courses of 30 to 90 lecture hours. It can also be used as 
a text for a first undergraduate course in Digital signal Processing (DSP). 

The organization of the book permits a great deal of flexibility in teaching the 
continuous-time and discrete-time concepts. The natural sequence of chapters is 
meant for a sequential approach in which all the continuous-time analysis is cov- 
ered first, followed by discrete-time analysis. It is also possible to integrate (inter- 
weave) continuous-time and discrete-time analysis by using a appropriate sequence 
of chapters. 
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MATLAB 


Throughout this book, examples have been provided to familiarize the reader 
with computer tools for systems design and analysis using the powerful and versatile 
software package MATLAB. Much of the time and cost associated with the analysis 
and design of systems can be reduced by using computer software packages for 
simulation. Many corporations will no longer support the development systems 
without prior computer simulation and numerical results which suggest a design 
will work. The examples and problems in this book will assist the reader in learning 
the value of computer packages for systems design and simulation. 

MATLAB is the software package used throughout this book. MATLAB is a 
powerful package developed to perform matrix manipulations for system designers. 
MATLAB is easily expandable and uses its own high level language. These factors 
make developing sophisticated systems easier. In addition, MATLAB has been 
carefully written to yield numerically stable results to produce reliable simulations. 

All the computer examples in this book are verified to be compatible with the 
student edition of the MATLAB when used according to the instructions given in 
its manual. The reader should make sure that \MATLAB\BIN is added in the DOS 
search path. MATLAB can be invoked by executing the command MATLAB. The 
MATLAB banner will appear after a moment with the prompt ‘>>’. MATLAB has 
a useful on-line help. To get help on a specific command, type HELP COMMAND 
NAME and then press the ENTER key. DIARY FILE is a command to record all 
the important keyboard inputs to a file and the resulting output of your MATLAB 
session to be written on the named file. MATLAB can be used interactively, or 
by writing functions (subroutines) often called M files because of the .M extension 
used for these files. Once familiar with the basics of MATLAB, the reader can easily 
learn how to write functions and to use MATLAB’s existing functions. 

The MATLAB M-files have been created to supplement this text. This includes 
all the examples solved by MATLAB in the text. These M-files may be retrieved 
from the Mathworks anonymous FTP site at 


ftp://ftp.mathworks.com/pub/books/lathi/. 
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The topics discussed in this chapter are not entirely new to students taking 
this course. You have already studied many of these topics in earlier courses or are 
expected to know them from your previous training. Even so, this background ma- 
terial deserves a review because it is so pervasive in the area of signals and systems. 
Investing a little time in such a review will pay big dividends later. Furthermore, 
this material is useful not only for this course but also for several courses that follow. 
It will also be helpful as reference material in your future professional career. 


B.1 Complex Numbers 


Complex numbers are an extension of ordinary numbers and are an integral 
part of the modern number system. Complex numbers, particularly imaginary 
numbers, sometimes seem mysterious and unreal. This feeling of unreality de- 
rives from their unfamiliarity and novelty rather than their supposed nonexistence! 
Mathematicians blundered in calling these numbers “imaginary,” for the term im- 
mediately prejudices perception. Had these numbers been called by some other 
name, they would have become demystified long ago, just as irrational numbers 
or negative numbers were. Many futile attempts have been made to ascribe some 
physical meaning to imaginary numbers. However, this effort is needless. In math- 
ematics we assign symbols and operations any meaning we wish as long as internal 
consistency is maintained. A healthier approach would have been to define a symbol 
i (with any term but “imaginary”), which has a property i? = —1. The history of 
mathematics is full of entities which were unfamiliar and held in abhorrence until 
familiarity made them acceptable. This fact will become clear from the following 
historical note. 


B.1-1 A Historical Note 


Among early people the number system consisted only of natural numbers 
(positive integers) needed to count the number of children, cattle, and quivers of 
arrows. These people had no need for fractions. Whoever heard of two and one-half 
children or three and one-fourth cows! 


2 Background 


However, with the advent of agriculture, people needed to measure continuously 
varying quantities, such as the length of a field, the weight of a quantity of butter, 
and so on. The number system, therefore, was extended to include fractions. The 
ancient Egyptians and Babylonians knew how to handle fractions, but Pythagoras 
discovered that some numbers (like the diagonal of a unit square) could not be 
expressed as a whole number or a fraction. Pythagoras, a number mystic, who 
regarded numbers as the essence and principle of all things in the universe, was so 
appalled at his discovery that he swore his followers to secrecy and imposed a death 
penalty for divulging this secret.1 These numbers, however, were included in the 
number system by the time of Descartes, and they are now known as irrational 
numbers. 

Until recently, negative numbers were not a part of the number system. The 
concept of negative numbers must have appeared absurd to early man. However, 
the medieval Hindus had a clear understanding of the significance of positive and 
negative numbers.” They were also the first to recognize the existence of absolute 
negative quantities. The works of Bhaskar (1114-1185) on arithmetic (Lildvati) 
and algebra (Bzjaganit) not only use the decimal system but also give rules for deal- 
ing with negative quantities. Bhaskar recognized that positive numbers have two 
square roots.® Much later, in Europe, the banking system that arose in Florence and 
Venice during the late Renaissance (fifteenth century) is credited with developing 
a crude form of negative numbers. The seemingly absurd subtraction of 7 from 5 
seemed reasonable when bankers began to allow their clients to draw seven gold 
ducats while their deposit stood at five. All that was necessary for this purpose was 
to write the difference, 2, on the debit side of a ledger.® 

Thus the number system was once again broadened (generalized) to include 
negative numbers. The acceptance of negative numbers made it possible to solve 
equations such as x +5 = 0, which had no solution before. Yet for equations such as 
z*+1=0, leading to x? = —1, the solution could not be found in the real number 
system. It was therefore necessary to define a completely new kind of number 
with its square equal to —1. During the time of Descartes and Newton, imaginary 
(or complex) numbers came to be accepted as part of the number system, but 
they were still regarded as algebraic fiction. The Swiss mathematician Leonhard 
Euler introduced the notation i (for imaginary) around 1777 to represent /—1. 
Electrical engineers use the notation j instead of i to avoid confusion with the 
notation i often used for electrical current. Thus 


p= l 
and 
vV-i=4j 
This notation allows us to determine the square root of any negative number. For 
example, 


V-4= V4x V=1 = £2; 


When imaginary numbers are included in the number system, the resulting 
numbers are called complex numbers. 


Origins of Complex Numbers 


Ironically (and contrary to popular belief), it was not the solution of a quadratic 
equation, such as z? + 1 = 0, but a cubic equation with real roots that made 


| 3B 
Gerolamo Cardano (left) and Karl Friedrich Gauss (right). 


imaginary numbers plausible and acceptable to early mathematicians. They could 
dismiss ZI as pure nonsense when it appeared as a solution to z? +1 = 0 
because this equation has no real solution. But in 1545, Gerolamo Cardano of 
Milan published Ars Magna (The Great Art), the most important algebraic work of 
the Renaissance. In this book he gave a method of solving a general cubic equation 
in which a root of a negative number appeared in an intermediate step. According 
to his method, the solution to a third-order equation{ 


z? +ar+b=0 


b b? 3 3 b b? 3 
~3tVatat V-2-Vate 


For example, to find a solution of zê + 6z — 20 = 0, we substitute a = 6, b = —20 
in the above equation to obtain 


z= 10+ V108 + 1/10 — V108 = 920.392 — 0.392 = 2 


We can readily verify that 2 is indeed a solution of zê + 6z — 20 = 0. But when 
Cardano tried to solve the equation z? — 15x — 4 = 0 by this formula, his solution 


is given by 


{This equation is known as the depressed cubic equation. A general cubic equation 
yi+py?t+qy+r=0 

can always be reduced to a depressed cubic form by substituting y = z— £. Therefore any general 
cubic equation can be solved if we know the solution to the depressed cubic. The depressed 
cubic was independently solved, first by Scipione del Ferro (1465-1526) and then by Niccolo 
Fontana (1499-1557). The latter is better known in the history of mathematics as Tartaglia 
(“Stammerer”). Cardano learned the secret of the depressed cubic solution from Tartaglia. He 
then showed that by using the substitution y = x — $, a general cubic is reduced to a depressed 


cubic. 


4 ` Background 


z= V2+V-121+ \/2- V-12] 


What was Cardano to make of this equation in the year 1545? In those days 
negative numbers were themselves suspect, and a square root of a negative number 
was doubly preposterous! Today we know that 


(2+4)? =24+j11=2+4V-121 


was 


Therefore, Cardano’s formula gives 
z=(2+j)+(2-j)=4 


We can readily verify that z = 4 is indeed a solution of z? — 152 — 4 = 0. Cardano 
tried to explain halfheartedly the presence of /—121 but ultimately dismissed the 
whole enterprise as being “as subtle as it is useless.” A generation later, however, 
Raphael Bombelli (1526-1573), after examining Cardano’s results, proposed ac- 
ceptance of imaginary numbers as a necessary vehicle that would transport the 
mathematician from the real cubic equation to its real solution. In other words, 
while we begin and end with real numbers, we seem compelled to move into an 
unfamiliar world of imaginaries to complete our journey. To mathematicians of the 
day, this proposal seemed incredibly strange.” Yet they could not dismiss the idea 
of imaginary numbers so easily because this concept yielded the real solution of an 
equation. It took two more centuries for the full importance of complex numbers to 
become evident in the works of Euler, Gauss, and Cauchy. Still, Bombelli deserves 
credit for recognizing that such numbers have a role to play in algebra.” 

In 1799, the German mathematician Karl Friedrich Gauss, at a ripe age 
of 22, proved the fundamental theorem of algebra, namely that every algebraic 
equation in one unknown has a root in the form of a complex number. He showed 
that every equation of the nth order has exactly n solutions (roots), no more and no 
less. Gauss was also one of the first to give a coherent account of complex numbers 
and to interpret them as points in a complex plane. It is he who introduced the 
term complex numbers and paved the way for general and systematic use of complex 
numbers. The number system was once again broadened or generalized to include 
imaginary numbers. Ordinary (or real) numbers became a special case of generalized 
(or complex) numbers. 

The utility of complex numbers can be understood readily by an analogy with 
two neighboring countries X and Y, as illustrated in Fig. B.1. If we want to travel 
from City a to City b (both in Country X), the shortest route is through Country Y, 
although the journey begins and ends in Country X. We may, if we desire, perform 
this journey by an alternate route that lies exclusively in X, but this alternate route 
is longer. In mathematics we have a similar situation with real numbers (Country 
X ) and complex numbers (Country Y). All real-world problems must start with real 
numbers, and all the final results must also be in real numbers. But the derivation 
of results is considerably simplified by using complex numbers as an intermediary. 
It is also possible to solve all real-world problems by an alternate method, using 
real numbers exclusively, but such procedure would increase the work needlessly. 


B.1-2 Algebra of Complex Numbers 


A complex number (a, b) or a + jb can be represented graphically by a point 
whose Cartesian coordinates are (a, b) in a complex plane (Fig. B.2). Let us denote 
this complex number by z so that 
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Fig. B.1 Use of complex numbers can reduce the work. 


z=at+jb (B.1) 


The numbers a and b (the abscissa and the ordinate) of z are the real part and 
the imaginary part, respectively, of z. They are also expressed as 

Rez=a 

Imz=b 
Note that in this plane all real numbers lie on the horizontal axis, and all imaginary 
numbers lie on the vertical axis. 

Complex numbers may also be expressed in terms of polar coordinates. If (r, 0) 
are the polar coordinates of a point z = a + jb (see Fig. B.2), then 
a=rcos @ 


b=rsin 6 
and 


z=a+jb=rcos@+jrsin 0 
= r(cos 6 + j sin 6) (B.2) 


t 
Imaginary 


Real > 


Fig. B.2 Representation of a number in the complex plane. 


6 Background 


The Euler formula states that 
e?? = cos 6 + j sin 8 


To prove the Euler formula, we expand ej? cos 8, and sin @ using a Maclaurin series 


(40)? _ (0)? | (G0) , (a), a)? 


je — : W eg MA AEE ch 
SIC gare a ee BES T 
Saa 8 0 ot o5 o 
Sitji- g-ig ator eh 
o gt o 68 
cose =l- Jt at ar 
; B o g 
sine =b- ata at 
Hence, it follows that 
ef? = cos 0 + j sin 6 (B.3) 
Using (B.3) in (B.2) yields 
z=a+ jb 
= ref? (B.4) 


Thus, a complex number can be expressed in Cartesian form a + jb or polar form 
rel? with 


a =r cos 6, b=rsin 8 (B.5) 
and 


r= Va? +b?, = tan (+) (B.6) 


Observe that r is the distance of the point z from the origin. For this reason, 
r is also called the magnitude (or absolute value) of z and is denoted by |z]. 
Similarly @ is called the angle of z and is denoted by 4z. Therefore 


ll =r, Zz =@6 


and 
z= Jzjeić? (B.7) 

Also 

1 1 1 _; 1 : 

ie a es | EOE A B 

z rel 7° Pi BS) 
Conjugate of a Complex Number 

We define z*, the conjugate of z = a + jb, as 


z*=a-jb=re% (B.9a) 


= |z\e7I 4" (B.9b) 
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Fig. B.3 Understanding some useful identities in terms of ret? 


The graphical representation of a number z and its conjugate z* is depicted in Fig. 
B.2. Observe that z* is a mirror image of z about the horizontal axis. To find the 
conjugate of any number, we need only to replace j by —j in that number (which 
is the same as changing the sign of its angle). 

The sum of a complex number and its conjugate is a real number equal to twice 
the real part of the number: 


z+2z* = (a + jb) + (a — jb) = 2a = 2Rez (B.10a) 
The product of a complex number z and its conjugate is a real number Iz, 


the square of the magnitude of the number: 
z2" = (a + jb)(a ~ jb) = a? + b? = |z|? (B.10b) 


Understanding Some Useful Identities 

In a complex plane, re’? represents a point at a distance r from the origin and 
at an angle @ with the horizontal axis, as shown in Fig. B.3a. For example, the 
number —1 is at a unit distance from the origin and has an angle r or —7 (in fact, 
any odd multiple of +7), as seen from Fig. B.3b. Therefore, 

leti" = -1 
In fact, 
etinT = 1 n odd integer (B.11) 


The number 1, on the other hand, is also at a unit distance from the origin, but 
has an angle 2m (in fact, +2nm for any integral value of n). Therefore, 


etsenn — 1 n integer (B.12) 


The number j is at unit distance from the origin and its angle is 7/2 (see Fig. B.3b). 
Therefore, 


eit /2 =j 
Similarly, 
—jn/2 -j 
Thus 
etit? = tj (B.13a) 


8 Background 


In fact, 
etinn/2 


=+j n= 1,5, 9, 13,--- (B.13b) 
and 


etint/2 = +; n = 3, 7, 11, 15,--- (B.13c) 


These results are summarized in Table B.1. 


+nr/2 etint/2 = 45 n=1,5,9,13,... 
+nr/2 etint/2 =j n=3,7,11,15,... 
S a CCC 


TABLE B.1 
OT EEEE E 
r 0 rel? 
1 0 =] 
1 in etit = 1 
1 tna etine = —1 n odd integer 
1 +27 etir = 1 
1 +2nn eti2n™ — 1 n integer 
1 tn /2 etiT/2 = +j 
1 
1 


This discussion shows the usefulness of the graphic picture of re#®. This picture 
is also helpful in several other applications. For example, to determine the limit of 
e(@+I4)t as t + o0, we note that 

elatswyt es erteiut 
Now the magnitude of e7* is unity regardless of the value of w or t because et = 
rej? with r = 1. Therefore, e% determines the behavior of e(*+J)! as t — oo and 


t= t—00 fore) a>0O 


: ; 0 a<0 
lim e(¢+34)t = lim eet = l (B.14) 


In future discussions you will find it very useful to remember rejl? as a number at a 
distance r from the origin and at an angle 6 with the horizontal axis of the complex 
plane. 


A Warning About Using Electronic Calculators in Computing Angles 


From the Cartesian form a+ jb we can readily compute the polar form rej? (see 
Eq. (B.6)]. Electronic calculators provide ready conversion of rectangular into polar 
and vice versa. However, if a calculator computes an angle of a complex number 
using an inverse trigonometric function 0 = tan~!(b/a), proper attention must be 
paid to the quadrant in which the number is located. For instance, @ corresponding 
to the number —2 — j3 is tan7!(=3). This result is not the same as tan71(3). 
The former is —123.7°, whereas the latter is 56.3°. An electronic calculator cannot 
make this distinction and can give a correct answer only for angles in the first and 
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(a) 


(©) (d) 
Fig. B.4 From Cartesian to polar form. 


fourth quadrants. It will read tan~!(=3) as tan~? ($), which is clearly wrong. In 
computing inverse trigonometric functions, if the angle appears in the second or 
third quadrant, the answer of the calculator is off by 180°. The correct answer is 
obtained by adding or subtracting 180° to the value found with the calculator (either 
adding or subtracting yields the correct answer). For this reason it is advisable to 
draw the point in the complex plane and determine the quadrant in which the point 
lies. This issue will be clarified by the following examples. 


E Example B.1 
Express the following numbers in polar form: 
(a) 2+43 (b) -2+jl (c) -2-j3 (d) 1-33 


(a) 
jel = /22+32=VI3 Lz = tan"? (3) = 56.3° 
In this case the number is in the first quadrant, and a calculator will give the correct value 


of 56.3°. Therefore, (see Fig. B.4a) 
2459 Vie 


le] = (2) +P =Vv5 Zz = tan’ (45) = 153.4 


In this case the angle is in the second quadrant (see Fig. B.4b), and therefore the answer 
given by the calculator (tant) = —26.6°) is off by 180°. The correct answer is 
(-26.6 + 180)° = 153.4° or — 206.6°. Both values are correct because they represent the 
same angle. As a matter of convenience, we choose an angle whose numerical value is less 
than 180°, which in this case is 153.4°. Therefore, 


a eee V5ei153-4° 


(b) 
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(c) 
jz} = y (-2} + (-3)? = V13 Lz= tan7*(=3 = —123.7° 


In this case the angle appears in the third quadrant (see Fig. B.4c), and therefore the 
answer obtained by the calculator (tan~'(=3) = 56.3°) is off by 180°. The correct answer 
is (56.3 + 180)° = 236.3° or — 123.7°. As a matter of convenience, we choose the latter 
and (see Fig. B.4c) 


—2 — j3 = VI3e 7ST 


(d) 
je} = V24 (-3} =V1I0 Zz = tan (3f) = —71.6° 


In this case the angle appears in the fourth quadrant (see Fig. B.4d), and therefore the 
answer given by the calculator (tan™> (3) = -71.6°) is correct (see Fig. B.4d). 


1=j3= vibe 1e Em 


© Computer Example CB.1 

Express the following numbers in polar form: (a) 2+4j3 (b) -2+ 91 

MATLAB function cart2pol(a,b) can be used to convert the complex number a + jb 
to its polar form. 


(a) 
[Zanglein_rad,Zmag] =cart2pol(2,3) 
Zangle_in-rad = 0.9828 
Imag =3.6056 
Zangle_in_deg=Zangle-in_rad*(180/pi) 
Zangle-in.deg=56.31 

Therefore 


z = 2 + j3 = 3.605672] 


(b) 
[Zangle_in_rad,Zmag]=cart2pol(-2,1) 
Zangle_in-rad = 2.6779 
Zmag =2.2361 
Zangle_in_deg=Zangle_in_rad*(180/pi) 
Zangle_in.deg=153 .4349 

Therefore 


z= -2 + j1 = 2.2361671534349 


Note that MATLAB automatically takes care of the quadrant in which the complex number 


lies. © 


@ Example B.2 

Represent the following numbers in the complex plane and express them in Cartesian 
form: (a) 27/3 (b) 4e-237/4 (e) 2657/2 (d) 3e~%9* (e) 24T (£) 2e734". 

(a) 2e" = 2 (cos $ +jsin 5) =1+jVv3 (see Fig. B.5a) 

(b) he PT = 4 (cos 3r —jsin 32) = -2V2 — j2v2 (see Fig. B.5b) 

(c) ae"? = 2 (cos z +jsin 3) = 2(0 + jl) = j2 (see Fig. B.5c) 

(d) 3e723" = 3(cos 34 — jsin 37) = 3(-1+j0)=-3 (see Fig. B.5d) 

(e) 20h = 2(cos 4x + jsin 4r) = 2(1 + j0) = 2 (see Fig. B.5e) 

(£) 2e794* = 2(cos 4r — j sin 4r) = 2(1 — j0) = 2 (see Fig. B.5f) a 


B.1 Complex Numbers 11 


(b) 


(c) 


(e) 
Fig. B.5 From polar to Cartesian form. 


© Computer Example CB.2 


Represent 4e~i*F in Cartesian form. ; 
MATLAB function pol2cart(@,7) converts the complex number ref? to Cartesian form. 


{Zreal,Zimag]=pol2cart (-3*pi/4,4) 
Zreal=-2.8284 
Zimag=-2.8284 

Therefore 


4e-J°E = —2.8284 — 52.8284 © 


Arithmetical Operations, Powers, and Roots of Complex Numbers 


To perform addition and subtraction, complex numbers should be expressed in 
Cartesian form. Thus, if 
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zy = 3454 = 5e 
and 


z2 = 2453 = V13e768 
then 


zı + z2 = (3 + j4) + (2 + 93) =5457 


If zı and z2 are given in polar form, we would need to convert them into Carte- 
sian form for the purpose of adding (or subtracting). Multiplication and division, 
however, can be carried out in either Cartesian or polar form, although the latter 
proves to be much more convenient. This is because if zı and z2 are expressed in 
polar form as 


zy = rye"! and =z) = rze” 
then : : i 
z122 = (169) (roet®?) = ryrget(®1+) (B.15a) 
and 6 
A aS T1 5(61~62) (B.15b) 
2 rges?2 T2 
Moreover, en , 
2” = (rei®)” = preiné (B.15c) 
and gy lin : 
21a = (re?) ™” = pl/nes0/n (B.15d) 


This shows that the operations of multiplication, division, powers, and roots can be 
carried out with remarkable ease when the numbers are in polar form. 


E Example B.3 
Determine z1z2 and 21/22 for the numbers 


z=34j4 = 53 


zg=2+j3= V13e7%5:3° 


We shall solve this problem in both polar and Cartesian forms. 


Multiplication: Cartesian Form 


zizg = (3 + j4)(2 + j3) = (6 — 12) + j(8 + 9) = -6 + j17 


Multiplication: Polar Form 
sama = (50) (Vet) = sy 


Division: Cartesian Form 
zı _ 3 +74 
z2 2458 
In order to eliminate the complex number in the denominator, we multiply both 
the numerator and the denominator of the right-hand side by 2 — 73, the denominator’s 
conjugate. This yields 
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zı (8+ 94)(2—j3) _ 18-j1_18-jl_ 18 1 


a’ G+- Bee is B I : 
Division: Polar Form 
a 5ef531" 5 ej(53.1°—56.3°) _ 5 ran | 


z2 /13e386-3°  V/13 v13 


It is clear from this example that multiplication and division are easier to accom- 
plish in polar form than in Cartesian form. 


E Example B.4 i 
For zı = 2ef"/4 and z2 = 8e'/%, find (a) 2z1ı -z2 (b) + (c) 4 (da) yz 
2 


(a) Since subtraction cannot be performed directly in polar form, we convert z, and 
z2 to Cartesian form: 


zı = 2e)7/4 = 2 (cos f+ jsin z) =vV2+jv2 


z2 = 8ef™/? = 8 (cos $+ jsin §) = 4+ j4v3 


Therefore, 
2z1 — z2 = 2(V2 + j V2) — (4 + j4v3) 
= (2V2 — 4) + j(2V2 — 4v3) 
= —1.17 — j4.1 
(b) 
12 l _ lyja 
zı  2ejT/4 2 
(c) - 
a 2At _ et Lagan leot 
z3 (Bein/3)?— 64e32/3 — 32 ~ 32 
(a) 


Yma = a} = (8e!) È = 8è (iT = 207? M 


© Computer Example CB.3 

Determine zız2 and z1/z2 if zı = 3 + j4 and z2 = 2 + j3 
Multiplication and division: Cartesian Form 

zl=3+j*4; z2=2+j*3; 

zlz2=z1*z2 

ziz2=-6.000+17 .0000i 

z1_over.z2=21/22 

zl_over_z2=1.3486-0.07691 
Therefore 


(3+ 74)(24+53)=—6+517 and (3+ 34)/(2+ 53) = 1.3486 - 0.0769 Ç) 


14 Background 


W Example B.5 
Consider F(w)}, a complex function of a real variable w: 


Fw) = 2+ jw 


= 34 ju (B.16a) 


(a) Express F(w) in Cartesian form, and find its real and imaginary parts. (b) 
Express F(w) in polar form, and find its magnitude |F(w)| and angle ¿F (w). 


(a) To obtain the real and imaginary parts of F(w), we must eliminate imaginary 
terms in the denominator of F(w). This is readily done by multiplying both the numerator 
and denominator of F(w) by 3 — j4w, the conjugate of the denominator 3 + j4w so that 


_ (2+jw)(3- jiw) _ (6+4w?)- jw 6 +40? Bw 


Cat A a a ag ae B.16b 
(3 + j4w)(3 — j4w) 9+ 16w? griez Igru (B169) 


F(w) 


This is the Cartesian form of F(w). Clearly the real and imaginary parts Fp(w) and Fi(w) 
are given by 


6 + 4w? —5w 
Fre) = Sat Rilo) = TFT 
(b) 
j VIF uZ eitan (4) 
F(w) = 2+jw a 4+we 


3+ jw 9+ 6? ef ton (t) 


Se, [Are eiltan-*(#)—tan-(4¢)] (B.16c) 


This is the polar representation of F(w). Observe that 


[F(w)| = Vi LF(w) = tan7? (2) ~ tan? (=) (B.17) 


B.2 Sinusoids 


Consider the sinusoid 
f(t) =C cos (2r Fot + 0) (B.18) 
We know that 
cos y = cos (y + 2nr) n = 0,+1,+2,43,--- 


Therefore, cos pọ repeats itself for every change of 27 in the angle y. For the 
sinusoid in Eq. (B.18), the angle 27¥ot + 0 changes by 2r when ¢ changes by 
1/Fo. Clearly, this sinusoid repeats every 1/Fo seconds. As a result, there are 
Fo repetitions per second. This is the frequency of the sinusoid, and the repetition 
interval Tp given by 


To = — (B.19) 
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is the period. For the sinusoid in Eq. (B.18), C is the amplitude, Fo is the 
frequency (in Hertz), and @ is the phase. Let us consider two special cases of this 


sinusoid when @ = 0 and 8 = —7/2 as follows: > 
(a) f(t) = C cos 2r Fot (8 = 0) 
(b) f(t) = Ccos (24 Fot — $) = C sin 2nFot (8 = =r /2) 


The angle or phase can be expressed in units of degrees or radians. Although 
the radian is the proper unit, in this book we shall often use the degree unit because 
students generally have a better feel for the relative magnitudes of angles when 
expressed in degrees rather than in radians. For example, we relate better to the 
angle 24° than to 0.419 radians. Remember, however, when in doubt, use the 
radian unit and, above all, be consistent. In other words, in a given problem or an 
expression do not mix the two units. 

It is convenient to use the variable wọ (radian frequency) to express 2r Fo: 


wo = 2r Fo (B.20) 
With this notation, the sinusoid in Eq. (B.18) can be expressed as 


f(t) = C cos (wot + 0) 
in which the period To is given by [see Eqs. (B.19) and (B.20)} 


1 Qn 
To = ALS = Da (B.21a) 
and 
gwsa (B.21b) 
To 


In future discussions, we shall often refer to wọ as the frequency of the signal 
cos (wot + 6), but it should be clearly understood that the frequency of this sinusoid 
is Fo Hz (Fo = wo/27m), and wo is actually the radian frequency. 

The signals C cos wot and C sin wot are illustrated in Figs. B.6a and B.6b re- 
spectively. A general sinusoid C cos (wot + @) can be readily sketched by shifting the 
signal C cos wot in Fig. B.6a by the appropriate amount. Consider, for example, 


f(t) = C cos (wot — 60°) 


This signal can be obtained by shifting (delaying) the signal C cos wot (Fig. B.6a) 
to the right by a phase (angle) of 60°. We know that a sinusoid undergoes a 360° 
change of phase (or angle) in one cycle. A quarter-cycle segment corresponds to 
a 90° change of angle. Therefore, an angle of 60° corresponds to two-thirds of a 
quarter-cycle segment. We therefore shift (delay) the signal in Fig. B.6a by two- 
thirds of a quarter-cycle segment to obtain C cos (wot — 60°), as shown in Fig. B.6c. 

Observe that if we delay C cos wot in Fig. B.6a by a quarter-cycle (angle of 90° 
or 7/2 radians), we obtain the signal C sin wot, depicted in Fig. B.6b. This verifies 
the well-known trigonometric identity 


C cos (wot — 3) = C sin wot (B.22a) 
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Coos Wyt 


` Csin Wot 


Ccos (wt — 60°) 


Fig. B.6 Sketching a sinusoid. 


Alternatively, if we advance C sin wot by a quarter-cycle, we obtain C cos wot. 
Therefore, 


C sin (wot + 3) = C cos wot (B.22b) 
This observation means sin wot lags cos wot by 90°(7/2 radians), or cos wot leads 
sin wot by 90°. 
B.2-1 Addition of Sinusoids 


Two sinusoids having the same frequency but different phases add to form a 
single sinusoid of the same frequency. This fact is readily seen from the well-known 
trigonometric identity 


C cos (wot + 0) = C cos 6 cos wot — C sin @ sin wot 


= a cos wot + bsin wot (B.23a) 
in which 


a = C cos 8, b= -Csin 0 
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Fig. B.7 Phasor addition of sinusoids. 


Therefore, 
C = Va? +b? (B.23b) 


9 = tan”! (=) (B.23c) 


a 


Equations (B.23b) and (B.23c) show that C and @ are the magnitude and angle, 
respectively, of a complex number a — jb. In other words, a ~ jb = Ce®, Hence, to 
find C and 6, we convert a — jb to polar form and the magnitude and the angle of 
the resulting polar number are C and @, respectively. 


To summarize, 
a cos wot + b sin wot = C cos (wot + 6) 


in which C and 9 are given by Eqs. (B.23b) and (B.23c), respectively. These happen 
to be the magnitude and angle, respectively, of a — jb. 

The process of adding two sinusoids with the same frequency can be clarified 
by using phasors to represent sinusoids. We represent the sinusoid C cos (wot + @) 
by a phasor of length C at an angle @ with the horizontal axis. Clearly, the sinusoid 
a cos wot is represented by a horizontal phasor of length a (8 = 0), while bsin wot = 
bcos (wot — 3) is represented by a vertical phasor of length b at an angle —1/2 with 
the horizontal (Fig. B.7). Adding these two phasors results in a phasor of length C 
at an angle @, as depicted in Fig. B.7. From this figure, we verify the values of C 
and @ found in Eqs. (B.23b) and (B.23c), respectively. 

Proper care should be exercised in computing @. Recall that tan71(=8) # 
tan~1(-.). Similarly, tan~1(=£) # tan-*(2). Electronic calculators cannot make 
this distinction. When calculating such an angle, it is advisable to note the quadrant 
where the angle lies and not to rely exclusively on an electronic calculator. A 
foolproof method is to convert the complex number a — jb to polar form. The 
magnitude of the resulting polar number is C and the angle is 8. The following 
examples clarify this point. 


E Example B.6 
In the following cases, express f(t) as a single sinusoid: 


(a) f(t) = cos wot — V3sin wot 
(b) f(t) = —3cos wot + 4sin wot 


(a) In this case, a = 1,b = — V3, and from Eqs. (B.23) 


C = 4/124 (v3)? =2 


6=tan + (£) = 60° 
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Therefore, 

f(t) = 2cos (wot + 60°) 
We can verify this result by drawing phasors corresponding to the two sinusoids. The 
sinusoid cos wot is represented by a phasor of unit length at a zero angle with the horizontal. 
The phasor sin wot is represented by a unit phasor at an angle of —90° with the horizontal. 
Therefore, — v3 sin wot is represented by a phasor of length V3 at 90° with the horizontal, 


as depicted in Fig. B.8a. The two phasors added yield a phasor of length 2 at 60° with 
the horizontal (also shown in Fig. B.8a). Therefore, 


f(t) = 2cos (wot + 60°) 


Alternately, we note that a — jb = 1+ jv3 = 2e1"/3. Hence, C = 2 and 9 = 77/3. 
Observe that a phase shift of +r amounts to multiplication by —1. Therefore, f (t) 
can also be expressed alternatively as 


f(t) = —2cos (wot + 60° + 180°) 


= —2cos (wot — 120°) 
= —2cos (wot + 240°) 


In practice, an expression with an angle whose numerical value is less than 180° is preferred. 


(b) In this case, a = —3,b = 4, and from Eqs. (B.23) 


C= V(-3)? +47 =5 
@ = tan * (=$) = -126.9° 
Observe that 


tan”? (=4) # tan™* ($) = 53.1° 
Therefore, 
f(t) = 5cos (wot — 126.9°) 


This result is readily verified in the phasor diagram in Fig. B.8b. Alternately, a — jb = 
-3 — j4 = 5e 1769" Hence, C = 5 and @ = —126.9°. E 


© Computer Example CB.4 

Express f(t) = —3cos wot + 4sin wot as a single sinusoid. 

Recall that acos wot +bsin wot = C cos [wot + tan” '(—b/a)|. Hence, the amplitude C 
and the angle @ of the resulting sinusoid are the magnitude and angle of a complex number 
a— jb. We use the ‘cart2pol’ function to convert it to the polar form to obtain C and 6. 

a=-3;b=4; 

[theta,C]=cart2pol(a,-b); 

Theta-deg=(180/pi)*theta; 


C,Theta.deg 

c=5 

Theta_deg=-126 .8699 
Therefore 


—3 cos wot + 4sin wot = 5 cos (wot — 126.8699°) © 


Fig. B.8 Phasor addition of sinusoids in Example B.6. 


We can also perform the reverse operation, expressing 


f(t) = C cos (wot + 6) 


in terms of cos wot and sin wot using the trigonometric identity 


C cos (wot + 6) = C cos 8 cos wot — C sin 8 sin wot 
For example, 


10 cos (wot — 60°) = 5 cos wot + 5V3sin wot 


Sinusoids in Terms of Exponentials: Euler’s Formula 


Sinusoids can be expressed in terms of exponentials using Euler’s formula [see 
Eq. (B.3)] 


Ls f 
cosp= 5 (ef? + eI?) (B.24a) 
Te pea 
sin y = z (et? — e71?) (B.24b) 
Inversion of these equations yields 
eJ? = cos y + j sin ọ (B.25a) 
e 9? = cos y — j sin y (B.25b) 


B.3 Sketching Signals 


In this section we discuss the sketching of a few useful signals, starting with 
exponentials. 


B.3-1 Monotonic Exponentials 


The signal e7% decays monotonically, and the signal e** grows monotonically 
with t (assuming a > 0) as depicted in Fig. B.9. For the sake of simplicity, we shall 
consider an exponential e~® starting at t = 0, as shown in Fig. B.10a. 

The signal e7% has a unit value att = 0. At t = 1/a, the value drops to 
1/e (about 37% of its initial value), as illustrated in Fig. B.10a. This time interval 
over which the exponential reduces by a factor e (that is, drops to about 37% of 
its value) is known as the time constant of the exponential. Therefore, the time 
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(b) 
Fig. B.9 Monotonic exponentials. 
constant of e~*! is 1/a. Observe that the exponential is reduced to 37% of its initial 
value over any time interval of duration 1/a. This can be shown by considering any 
set of instants tı and tz separated by one time constant so that 
te-ty=+ 
Now the ratio of e~*? to e~%" is given by 


ete 


ea ati 


= eo elta—th) = i = 0.37 


e~" u(t) e7? u(t) 


(a) (b) 
Fig. B.10 (a) Sketching e~*’ (b) sketching en, 


We can use this fact to sketch an exponential quickly. For example, consider 


FE) =e” 


The time constant in this case is 1/2. The value of f(t)att=0is1. Att = 1/2 (one 
time constant) it is 1/e (about 0.37). The value of f(t) continues to drop further by 
the factor 1/e (37%) over the next half-second interval (one time constant). Thus 
f(t) at t = 1 is (1/e)?. Continuing in this manner, we see that f(t) = (1/e)® at 
t = 3/2 and so on. A knowledge of the values of f(t) at t = 0, 0.5, 1, and 1.5 
allows us to sketch the desired signal} as shown in Fig. B.10b. For a monotonically 


{If we wish to refine the sketch further, we could consider intervals of half the time constant over 
which the signal decays by a factor 1/,/e. Thus, at t = 0.25, f(t) = 1/Ve, and at t = 0.75, 
f(t) = Leve, etc. 
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(a) 
1 
cos (6t — 60°) 
(b) 
4e72! 
4e-2' cos (6t — 60°) 
(c) 


Fig. B.11 Sketching an exponentially varying sinusoid 


growing exponential e?*, the waveform increases by a factor e over each interval of 
1/a seconds. 


B.3-2 The Exponentially Varying Sinusoid 
We now discuss sketching an exponentially varying sinusoid 
f(t) = Ae~* cos (wot + 8) 
Let us consider a specific example 
f(t) = 4e7** cos (6t — 60°) (B.26) 
We shall sketch 4e~2* and cos (6t — 60°) separately and then multiply them. 
(i) Sketching 4e~* 


This monotonically decaying exponential has a time constant of 1/2 second 
and an initial value of 4 at t = 0. Therefore, its values at t = 0.5, 1, 1.5, and 2 
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are 4/e, 4/e, 4/e3, and 4/e*, or about 1.47, 0.54, 0.2, and 0.07 respectively. Using 
these values as a guide, we sketch 4e~t, as illustrated in Fig. B.11a. 


(ii) Sketching cos (6t — 60°) 


The procedure for sketching cos (6t — 60°) is discussed in Sec. B.2 (Fig. B.6c). 
Here the period of the sinusoid is To = 20/6 ~= 1, and there is a phase delay of 60°, 
or two-thirds of a quarter-cycle, which is equivalent to about a (60/360)(1) ~ 1/6 
second delay (see Fig. B.11b). 


(iii) Sketching 4e~?*cos (6t — 60°) 


We now multiply the waveforms in (i) and (ii). The multiplication amounts to 
forcing the amplitude of the sinusoid cos (6t — 60°) to decrease exponentially with a 
time constant of 0.5. The initial amplitude (at t = 0) is 4, decreasing to 4/e (=1.47) 
at t = 0.5, to 1.47/e (=0.54) at t = 1, and so on. This is depicted in Fig. B.11c. 
Note that at the instants where cos (6t — 60°) has a value of unity (peak amplitude), 


4e% cos (6t — 60°) = 4e~”* (B.27) 


Therefore, 4e7% cos (6t — 60°) touches 4e-2* at those instants where the sinusoid 
cos (6t — 60°) is at its positive peaks. Clearly 4e~2t is an envelope for positive 
amplitudes of 4e—** cos (6t — 60°). Similarly, at those instants where the sinusoid 
cos (6t — 60°) has a value of —1 (negative peak amplitude), 


4e~** cos (6t — 60°) = —4e 7” (B.28) 


and 4e7%" cos (6t — 60°) touches —4e~* at its negative peaks. Therefore, —4e~7 
is an envelope for negative amplitudes of 4e~*t cos (6t — 60°). Thus, to sketch 
4e7% cos (6t — 60°), we first draw the envelopes 4e-2t and —4e~** (the mirror image 
of 4e~2¢ about the horizontal axis), and then sketch the sinusoid cos (6t — 60°), with 
these envelopes acting as constraints on the sinusoid’s amplitude (see Fig. B.11c). 

In general, K e~* cos (wot +6) can be sketched in this manner, with Ke7% and 
_Ke7-% constraining the amplitude of cos (wot + 8). 


B.4 Cramer's Rule 


This is a very convenient rule used to solve simultaneous linear equations. 
Consider a set of n linear simultaneous equations in n unknowns £1, £2, .-+) Tn: 


ariz + aizta +++ + antn = Y1 
a2121 + ao2%2 t't + Gantn = Y2 
(B.29) 


anizi + n232 + °° + annin = Yn 


These equations can be expressed in matrix form as 
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aii 412 ain | |71 yı 
aa 422 t Gan T2 y2 = 
= (B.30) 
Ani an2 `° ünn In Yn 


We denote the matrix on the left-hand side formed by the elements a;; as A. The 
determinant of A is denoted by |A|. If the determinant |A| is not zero, the set of 
equations (B.29) has a unique solution given by Cramer’s formula 


_ [Da] 
|A| 
where |D,| is obtained by replacing the kth column of |A| by the column on the 
right-hand side of Eq. (B.30) (with elements y1, y2, ---5 Yn)- 
We shall demonstrate the use of this rule with an example. 


Lk k=1,2,...,7 (B.31) 


@ Example B.7 
Using Cramer’s rule, solve the following simultaneous linear equations in three un- 
knowns: 


22, +22 +23 =3 
21+ 322-23 =7 
zi+z2+23=1 


In matrix form these equations can be expressed as 


2.1 1 zi 3 
1 3 -1 rm2) = |7 
111 T3 1 
Here, 
2 1 1 


|AJ=/1 3 -1|=4 


E ol 


Since |A| = 4 # 0, a unique solution exists for x1, 22, and z3. This solution is provided 
by Cramer’s rule (B.31) as follows: 


31 1 
1 8 
= — |7 -lj=-= 
Tı (Al 3 a 2 
l l 1 
23 1 
1 4 
=—|1 7 -lj=-s= 
cea ieee 
111 


nance TA SST a ee M 
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2 1 3 
1 -8 
=— |1 =—=-2 E 
T3 [A] 3 7 7 
1 1 1 


© Example CB.5 
Using a Computer, solve Example B.7. 
A = [21431 3-131 11); b={3 7 1)’; 
for k=1:3 
A1=A; 
Al(:,k)=b; 
D=A1; 
x(k)=det(D) /det(A); 
end 
x=x’ 
x= 2 


B.5 Partial Fraction Expansion 


In the analysis of linear time-invariant systems, we encounter functions that 
are ratios of two polynomials in a certain variable, say z. Such functions are known 
as rational functions. A rational function F(z) can be expressed as 


bm” + bm} tree + biz + bo 
7 tbm- + +++ + biz + bo B.32 
F(a) s” tanir" l+- Har + a9 ( ) 
Pl) (B.33) 
Q(z) 


The function F(z) is improper if m > n and proper ifm < n. An improper 


function can always be separated into the sum of a polynomial in x and a proper 
function. Consider, for example, the function 


2a? + 92? + llr +2 

z? +47 +3 
Because this is an improper function, we divide the numerator by the denominator 
until the remainder has a lower degree than the denominator. 


F(z) = (B.34a) 


2z+1 
T? + dx +3) 223 + 922+1l1z + 2 
22? + 82°+60 


z*+5r +2 
w?+4e +3 


r-i 
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Therefore, F(z) can be expressed as 


223 + 92? 4+ liz +2 z-1 
F(z) = ——~—_—_——$ =_ 2x41 -m B.34b 
(2) r? + 4r +3 ais TEETE) ( ) 
polynomial ing —{ ———— 


proper function 


A proper function can be further expanded into partial fractions. The remaining 
discussion in this section is concerned with various ways of doing this. 


B.5-1 Partial Fraction Expansion: Method of Clearing Fractions 


This method consists of writing a rational function as a sum of appropriate par- 
tial fractions with unknown coefficients, which are determined by clearing fractions 
and equating the coefficients of similar powers on the two sides. This procedure is 
demonstrated by the following example. 


E Example B.8 
Expand the following rational function F(z) into partial fractions: 


x? + 307 +4r +6 
(x + 1)(x + 2)(x + 3)? 
This function can be expressed as a sum of partial fractions with denominators (x + 1), 
(z + 2), (z +3), and (z + 3), as shown below. 
z? +327 +40 +6 ky k2 ks ka 


Fe)" GFA 241 tesa saa Gaal 


F(z) = 


To determine the unknowns ky, k2, k3, and k4 we clear fractions by multiplying both sides 
by (x + 1)(z + 2)(x + 3)? to obtain 


x? + 327+ 40 + 6 = ki(x® + 8x? + 212 + 18) + ko(x? + 72? + 152 +9) 
+ ka(x* + 6x? + 11x + 6) + ka(x? + 3x + 2) 
= 0° (ki + ko + k3) + 2?(8k1 + 7ke + 6ks + ka) 
+ 2(21k; + 15k2 + 11k3 + 3k4) + (18k1 + Oko + 6k3 + 2ka) 
Equating coefficients of similar powers on both sides yields 
ki t+ko+k3=1 
8k1 + 7k2 + 6k3 + k4 = 3 
21k, + 15k2 + 11k3 + 3k4 = 4 
18k + 9k2 + 6k3 + 2k4 = 6 
Solution of these four simultaneous equations yields 
ki, =1, ko = —2, k3 = 2, k4 = —3 


Therefore, 
1 2 2 3 
F(z) = - Hie a o] 
(2) zr+1 242243 (x + 3)? 


Although this method is straightforward and applicable to all situations, it is 
not necessarily the most efficient. We now discuss other methods which can reduce 
numerical work considerably. 


ave a Cn TER PE RP ST SE A 
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B.5-2 Partial Fractions: The Heaviside “Cover-Up” Method 
1. Unrepeated Factors of Q(z) 


We shall first consider the partial fraction expansion of F(x) = P(z)/Q(z), in 
which all the factors of Q(z) are unrepeated. Consider the proper function 


bmz™ + bmie™} +- + biz + bo 
peja e tomar Et FEto een 
£” + an-12"”7} +: + ar + ag 


a 
~ (z= M )(z — A2) (a ~ An) (B.35a) 


We can show that F(z) in Eq. (B.35a) can be expressed as the sum of partial 
fractions 


k k k 
1 + 2 cares n 


F(z) = 
Oo ei SEN 


(B.35b) 


To determine the coefficient kı, we multiply both sides of Eq. (B.35b) by z — A; 
and then let z = 4. This yields 


(z = à1)F (z)lz=\ = k1 + a + ae | ae ia 
On the right-hand side, all the terms except kı vanish. Therefore, 
ky = (£ ~ 1) F(z)|g-, (B.36) 
Similarly, we can show that 
kr = (z — Ar) F(z)l poy, r=1,2,---,n (B.37) 


@ Example B.9 
Expand the following rational function F(a) into partial fractions: 


Qa? + 9a — 11 ky k2 k3 


Fe) = GFE- Jet z+ z-2' z+3 


To determine ki, we let x = —1 in (z + 1)F (z). Note that (x + 1)F(z) is obtained 
from F(x) by omitting the term (x + 1) from its denominator. Therefore, to compute 
kı corresponding to the factor (x + 1), we cover up the term (z + 1) in the denominator 
of F(x) and then substitute x = —1 in the remaining expression. (Mentally conceal the 
term (x +1) in F(a) with a finger and then let r = —1 in the remaining expression.) The 
procedure is explained step by step below. 


2z? +92 — 11 
{x + 1)(z — 2)(x + 3) 


Step 1: Cover up (conceal) the factor (x + 1) from F(z): 


P(r) = 
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2r? +90 — 11 
— g — 2)(x + 3) k 
Step2: Substitute z = —1 in the remaining expression to obtain kı: 
po BOM -18 _, 


Gaa a 


Similarly, to compute k2, we cover up the factor (z — 2) in F(z) and let z = 2 in the 
remaining function, as shown below. 


‘ee Qn? 4+ 9x — 11 _ 8+18-11 15 
(+1 MBE +3)|,_, @+2+3) 1s 
and 
ie 2z? + 92 — 11 __18-2-1 Ss 
C+C- 2) |. , (38+ )(-3-2) 10 
Therefore, 


227 +92 — 11 3 1 2 


Fle) = G e- Jet 2+1 #2 243 


Complex Factors in F(x) 


The procedure above works regardless of whether the factors of Q(z) are real 
or complex. Consider, for example, 


4r? + Ix +18 
F(z) = —— B.38 
(2) (z + 1)(x? + 4a + 13) (PON 
4r? + 2x +18 
~ (z +1)(a +2- j3)(z + 2+ j3) 
>, kı k2 k3 
= 241 z+2-j3 eee gs 
where 
4z? + 2r +18 
ky = =2 
ma’ +42 +13)]|,2-4 
Similarly, 
2 e o 
n= | 4z +2z +18 : | = 1+ j2 = V534 
(z +1) (z +2 + j3) J ,- 9453 
2 s o 
k3 = | 4z? + az +18 | = 1 — j2 = V5e718343 
(z +1)(z + 2 — 43) z=—2—j3 
Therefore, 


2 V5e163-43° V5e —j63.43° 


F = ——q~ —— 
(e) = It 242 j3 m4213 


(B.39) 


i 
i 
i 
i 
i 
l 
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The coefficients kg and k3 corresponding to the complex conjugate factors are also 
conjugates of each other. This is generally true when the coefficients of a rational 
function are real. In such a case, we need to compute only one of the coefficients. 


2. Quadratic Factors 


Often we are required to combine the two terms arising from complex conjugate 
factors into one quadratic factor. For example, F(x) in Eq. (B.38) can be expressed 
as 


F(z)= 4r? + 2r + 18 o k Cyr + c2 
~ (z +1)(e? +42 +13) z+1 22442413 


The coefficient kı is found by the Heaviside method to be 2. Therefore, 


4z? + Qe + 18 2 cz + co 
M = M H MMM B.40 
(x +1)(z? + 4z + 13) fl eee ( ) 


The values of c} and cz are determined by clearing fractions and equating the 
coefficients of similar powers of z on both sides of the resulting equation. Clearing 
fractions on both sides of Eq. (B.40) yields 


4r? + 22 +18 = 2(x? + 4x + 13) + (cre + c2)(x + 1) 
= (2 + c1)£? + (8 + c1 + cg)z + (26 + c3) (B.41) 
Equating terms of similar powers yields cı = 2, cp = —8, and 


4r? + 22 +18 2 2r -8 


GFG iets) ed z344 l3 


(B.42) 


Short-Cuts 


The values of cı and c2 in Eq. (B.40) can also be determined by using short- 
cuts. After computing kı = 2 by the Heaviside method as before, we let z = 0 on 
both sides of Eq. (B.40) to eliminate cı. This gives us 


18 c2 

— = 2 + — 

Therefore, ne 13 
cg = —8 


To determine c1, we multiply both sides of Eq. (B.40) by z and then let z — oo. 
Remember that when z — 00, only the terms of the highest power are significant. 
Therefore, 
4=ki +a =2+c; 
and 
cy =2 


In the procedure discussed here, we let x = 0 to determine cz and then multiply 
both sides by z and let x — oo to determine c1. However, nothing is sacred about 
these values (x = 0 or z = œo). We use them because they reduce the number of 


1 
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computations involved. We could just as well use other convenient values for z, 


such as x = 1. Consider the case n 
Qn? + 4r +5 
F(s) = AT 
(2) z(z? + 22 +5) 
k ciz +2 


= z i r? +2r +5 
We find k = 1 by the Heaviside method in the usual manner. As a result, 


2r? + 4r +5 1 cit + c2 
> = -+ aM B.43 
x(x? + 22 + 5) pt stor +s (5:43) 


To determine cı and c3, if we try letting z = 0 in Eq. (B.43), we obtain co on both 
sides. So let us choose z = 1. This yields 


11 ate 
pate 
or 
cite =3 


We can now choose some other value for z, such as z = 2, to obtain one more 
relationship to use in determining cı and c2. In this case, however, a simple method 
is to multiply both sides of Eq. (B.43) by z and then let x — oo. This yields 


2=1+c, 
so that 


Therefore, 


B.5-3 Repeated Factors in Q(z) 


If a function F(x) has a repeated factor in its denominator, it has the form 


P(x) 


F(z) = —— B.44 
(2) (x — à)" (x — a1) (x — ag)--+ (£ — aj) ( ) 
Its partial fraction expansion is given by 
ao ay ar—-1 
Fe ce et SE NT 
Aou Gane EA 
k k k; 
LO 4—7 +. + H (B45) 
Z-ay, r-a? t-aj 
The coefficients k1, kg, ..., kj corresponding to the unrepeated factors in this equa- 


tion are determined by the Heaviside method, as before [Eq. (B.37)]. To find the 
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coefficients ap, a1, a2, ..., @r—1, we multiply both sides of Eq. (B.45) by (z — A)". 
This gives us 


(a — d)"F (x) = ao + ay (a — A) + a(x — A)? +++» + api (z — A)? 


- A)" - x)" — x)" 
Fe achat aoe en) aak EEN (B.46) 
zT — Qi z — Q2 T — On 
If we let z = A on both sides of Eq. (B.46), we obtain 
(z — d)"F(z)|,-) = a0 (B.47a) 


Therefore, ag is obtained by concealing the factor (z — A)" in F(x) and letting 
x = A in the remaining expression (the Heaviside “cover up” method). If we take 
the derivative (with respect to x) of both sides of Eq. (B.46), the right-hand side is 
a+ terms containing a factor (x — À) in their numerators. Letting z = A on both 
sides of this equation, we obtain 


+ [(e-F@)| 


AA 

Thus, a; is obtained by concealing the factor (x — \)" in F(z), taking the derivative 
of the remaining expression, and then letting z = \. Continuing in this manner, we 
find 

1 


aj = 5 Gay le -AFC 


(B.47b) 


z= 
Observe that (x — A)"F(z) is obtained from F(z) by omitting the factor (z — A)” 
from its denominator. Therefore, the coefficient a; is obtained by concealing the 


factor (z — à)” in F(z), taking the jth derivative of the remaining expression, and 
then letting x = A (while dividing by j!). 


E Example B.10 
Expand F(x) into partial fractions if 


4r? + 1627 + 232 + 13 


P(z)= 
(2) (a + 1)3(x + 2) 
The partial fractions are 
ao a a2 k 
F = + ees aa 
IS ea) Gai sal eee 


The coefficient k is obtained by concealing the factor (x +2) in F(x) and then substituting 
x = —2 in the remaining expression: 


p Att lôr? + 232 + 13 
z (z+ 1 


To find ao, we conceal the factor (z + 1)° in F(x) and let z = —1 in the remaining 
expression: 


=1 


z=—2 


_ 42° + 162? + 232 +13 


(+2 ai 


ag 


r=-1 
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To find ai, we conceal the factor (x + 1)? in F(z), take the derivative of the remaining 
expression, and then let z = —1: 


irs d kP 4 
dz PG +2) ERA 
Similarly, 
a-l Ë p ae 
2! dz? z+ 2) aes 
Therefore, 
F(z) 2 1 3 1 a 


=P aie atl ee? 


B.5-4 A Hybrid Method: Mixture of the Heaviside “Cover-Up” and 
Clearing Fractions 


For multiple roots, especially of higher order, the Heaviside expansion method, 
which requires repeated differentiation, can become cumbersome. For a function 
which contains several repeated and unrepeated roots, a hybrid of the two pro- 
cedures proves the best. The simpler coefficients are determined by the Heaviside 
method, and the remaining coefficients are found by clearing fractions or short-cuts, 
thus incorporating the best of the two methods. We demonstrate this procedure by 
solving Example B.10 once again by this method. 

In Example B.10, coefficients k and ag are relatively simple to determine by 
the Heaviside expansion method. These values were found to be kı = 1 and ag = 2. 
Therefore, 


423 + 16x? + 232 +13 2 ai ag 1 


= +2 +— 
(c + 1)5(@ + 2) Geile Gee “srl 242 


We now multiply both sides of the above equation by (x + 1)3(z + 2) to clear the 
fractions. This yields 


4r? + 162? + 232 + 13 
= 2(x + 2) + a(z + 1)(z + 2) +az(z +1)? (z + 2) + (z + 1)? 
= (1 + a2)£? + (a) + dag + 3)x? + (5 + 3a) + 5a2)z + (4 + 2a) + 2a2 + 1) 


Equating coefficients of the third and second powers of z on both sides, we obtain 
1 +a =4 a, =1 
= 
aı + 4a2 + 3 =16 aq =3 


We may stop here if we wish because the two desired coefficients, a, and az, are 
now determined. However, equating the coefficients of the two remaining powers of 
x yields a convenient check on the answer. Equating the coefficients of the z? and 
x° terms, we obtain 


23 = 5+ 3a; + 5a2 


13 = 4 + 2a; + 2a2 +1 


32 Background 
These equations are satisfied by the values a} = 1 and az = 3, found earlier, 
providing an additional check for our answers. Therefore, 


pe ee aap 
“+1 (+1? z+1 2+2 


which agrees with the previous result. 


A Mixture of the Heaviside “Cover-Up” and Short Cuts 


In the above example, after determining the coefficients ag = 2 and k = 1 by 
the Heaviside method as before, we have 


4r? + 16r? +232 +13 _ 2 £ ai P a2 + 1 
(z + 1)3(a + 2) “(tl (etl)? c+1 2+2 
There are only two unknown coefficients, a1 and az. If we multiply both sides of 
the above equation by z and then let x — oo, we can eliminate a;. This yields 


4=a+1 => a2=3 
Therefore, 


4r? +162? +23 +13 _ 2 “4 3 
(z +1)}(z + 2) “+l (+1? z+1 z+2 
There is now only one unknown aj, which can be readily found by setting x equal 
to any convenient value, say z = 0. This yields 


B=2+a+3+3 = a=l 


which agrees with our earlier answer. 


B.5-5 Improper F(z) with m=n 


A general method of handling an improper function is indicated in the begin- 
ning of this section. However, for a special case where the numerator and denom- 
inator polynomials of F(x) are of the same degree (m = n), the procedure is the 
same as that for a proper function. We can show that for 


bnr” + bn-12”7! +- +bız + bo 


F(z) = n n-i 
2” + anif +++: +a1z + a0 
ki ka kn 
= bn + — + — tH 
ni t=) 2A z — Àn 
the coefficients kı, k2,- , Kn are computed as if F (x) were proper. Thus, 


kr = (x ias Ar) F (2) leer, 


For quadratic or repeated factors, the appropriate procedures discussed in Secs. 
B.5-2 or B.5-3 should be used as if F(x) were proper. In other words, when m = n, 
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the only difference between the proper and improper case is the appearance of an 
extra constant bn in the latter. Otherwise the procedure remains the same. The 
proof is left as an exercise for the reader. 


E Example B.11 
Expand F(z) into partial fractions if 
327 +9a—20 _ 3z? +9r — 20 
w+a2-6  (z-2)(z+3) 
Here m = n = 2 with bn = b2 = 3. Therefore, 


F(z) = 


3z? + 2 — 20 kı k2 
F(z) = = =3 pis 
es (=) = Gras 3) t3273 
in which 
p, = Stat 9r — 20 _ 12418-2010 _, 
j @+3)| 2 (2+3) 5 
and T 
p, = 32+ 92 = 20 _ 27-27-20 _ -20_, 
acc) | ror ie 
Therefore, 
3z? + 9x — 20 2 4 
F(x) = a =+ 
(2) (x — 2)(x + 3) +cat ets a 


B.5-6 Modified Partial Fractions 


Often we require partial fractions of the form any rather than TAF This 
can be achieved by expanding F (z)/z into partial fractions. Consider, for example, 


5a? + 20r + 18 

F(z) = —— n n 

C) = GAEI 
Dividing both sides by z yields 

F(z) _ 5a? + 20r + 18 


z a(x + 2)(x + 3)? 
Expansion of the right-hand side into partial fractions as usual yields 


F(z) 527+ 202 + 18 _ a az y as g a4 
T = æ+) (+3 z z+2 (+3) (z+3}? 
Using the procedure discussed earlier, we find a; = 1, ag = 1, a3 = —2, and a4 = 1. 
Therefore, : 
F 1 1 2 1 
ORES 


z z 742 243 G13) 
Now multiplying both sides by z yields 


x 2z x 


- —; + 
z+2 z+3 («+3) 
This expresses F(x) as the sum of partial fractions having the form wn: 


F(z) =1+ 
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B.6 Vectors and Matrices 


An entity specified by n numbers in a certain order (ordered n-tuple) is an 
n-dimensional vector. Thus, an ordered n-tuple (21, 2,..., Zn) represents an 
n-dimensional vector x. Vectors may be represented as a row (row vector): 


x=[z1 22 > Zn] 


or as a column (column vector): 


Simultaneous linear equations can be viewed as the transformation of one vector 
into another. Consider, for example, the n simultaneous linear equations 


yi = 4412, + 01212 +++ + GinTn 


Y2 = 02111 + aggr2g +++ + Gantn 


(B.48) 
Ym = mil + Gm2t2+-°°° + amnIn 
If we define two column vectors x and y as 
T1 yı 
z2 y2 
x= , y= (B.49) 
Tn Ym 


then Eqs. (B.48) may be viewed as the relationship or the function that transforms 
vector x into vector y. Such a transformation is called the linear transformation 
of vectors. In order to perform a linear transformation, we need to define the array 
of coefficients aij appearing in Eqs. (B.48). This array is called a matrix and is 
denoted by A for convenience: 


@11 a12 Pars Gin 
@21 a22 an 

A= (B.50) 
ami Am2 `` Smn 
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A matrix with m rows and n columns is called a matrix of the order (m,n) or an 
(m x n) matrix. For the special case where m = n, the matrix is called a square 
matrix of order n. s 

It should be stressed at this point that a matrix is not a number such as a 
determinant, but an array of numbers arranged in a particular order. It is convenient 
to abbreviate the representation of matrix A in Eq. (B.50) with the form (ai;)mxn, 
implying a matrix of order m x n with aij as its ijth element. In practice, when the 
order m x n is understood or need not be specified, the notation can be abbreviated 
to (aij). Note that the first index i of a;; indicates the row and the second index j 
indicates the column of the element a;; in matrix A. 

The simultaneous equations (B.48) may now be expressed in a symbolic form 


as 
y= Ax (B.51) 
or 
yı @11 a12 Qin T1 
y2 a21 a22 i ate an T2 
2 (B.52) 
Ym aml G2 ` amn Tn 


Equation (B.51) is the symbolic representation of Eq. (B.48). As yet, we have not 
defined the operation of the multiplication of a matrix by a vector. The quantity 
Ax is not meaningful until we define such an operation. 


B.6-1 Some Definitions and Properties 


A square matrix whose elements are zero everywhere except on the main diag- 
onal is a diagonal matrix. An example of a diagonal matrix is 


20 0 
0 11 0 
00 5 


A diagonal matrix with unity for all its diagonal elements is called an identity 
matrix or a unit matrix, denoted by I. Note that this is a square matrix: 


100- 0 
010- 0 

I=|0 01> 0 (B.53) 
0 °O Ge 4A 


The order of the unit matrix is sometimes indicated by a subscript. Thus, In 
represents the n x n unit matrix (or identity matrix). However, we shall omit the 
subscript. The order of the unit matrix will be understood from the context. 
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A matrix having all its elements zero is a zero matrix. 

A square matrix A is a symmetric matrix if ai; = aji (symmetry about the 
main diagonal). 

Two matrices of the same order are said to be equal if they are equal element 
by element. Thus, if 


A= (aij )mxn and B= (bij )mxn 


then A = B only if aij = 6;; for all i and j. 
If the rows and columns of an m x n matrix A are interchanged so that the 
elements in the ith row now become the elements of the ith column (for i =1, 2, 
. , m), the resulting matrix is called the transpose of A and is denoted by AT. 
It is evident that AT is an n x m matrix. For example, if 


2 1 
2.3: 
A=1/3 2| then A?= 
1 23 
1 3 
Thus, if 
A = (aij)mxn 
then 
AT = (aji)nxm (B.54) 
Note that 
(ATF =A (B.55) 


B.6-2 Matrix Algebra 


We shall now define matrix operations, such as addition, subtraction, multipli- 
cation, and division of matrices. The definitions should be formulated so that they 
are useful in the manipulation of matrices. 


1. Addition of Matrices 


For two matrices A and B, both of the same order (m x n), 


ail 0 412 ' Glin bu biz? tt bin 

a21 022 Gan b21 b22 ban 
A= and B= 

aml m2 amn bmi bm2 bmn 


we define the sum A + B as 
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(a tb) (ai2t+b2) = (ain + bin) 
(az +b21) (a22 +b22) >> (Gant bon) 
A+B= 
(amı + bmi) (am2 + bm2) ce (amn + bmn) 
or 


A+B = (aij + bij )mxn 


Note that two matrices can be added only if they are of the same order. 


2. Multiplication of a Matrix by a Scalar 


We define the multiplication of a matrix A by a scalar c as 


ail @12 ose Gin cai1 cai12 om Cain 

a21 a22 sts amn ca21 cCa22 ses Can 
cA =c = 

aml G@m2 `’ amn Cami COm2 ‘*' C&mn 


3. Matrix Multiplication 
We define the product 
AB=C 


in which cij, the element of C in the ith row and jth column, is found by adding 
the products of the elements of A in the ith row with the corresponding elements 
of B in the jth column. Thus, 


cij = Girbiy + aizbaj +++ + Ginbnj 


n 
SS (B.56) 
k=1 


This result is shown below. 


bij 
ba; 
Qi, i2 °° Gin vee Bag ser Cig 
bnj L a” 


A(mxn) B(nxp) C(mxp) 
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Note carefully that the number of columns of A must be equal to the number of 
rows of B if this procedure is to work. In other words, AB, the product of matrices 
A and B, is defined only if the number of columns of A is equal to the number of 
rows of B. If this condition is not satisfied, the product AB is not defined and is 
meaningless. When the number of columns of A is equal to the number of rows of 
B, matrix A is said to be conformable to matrix B for the product AB. Observe 
that if A is an m x n matrix and B is an n x p matrix, A and B are conformable 
for the product, and C is an m x p matrix. 

We demonstrate the use of the rule in Eq. (B.56) with the following examples. 


23 8 9 57 
a 
11 =|3 423 
oor 
3 1 5 1047 
2 


[2 1 3ļ]|ıļ=8 
1 


In both cases above, the two matrices are conformable. However, if we interchange 
the order of the matrices as follows, 


2 3 
1 3 1 2 
| 1 1 
2 1 1 1 
3 1 
the matrices are no longer conformable for the product. It is evident that in general, 


AB#BA 


Indeed, AB may exist and BA may not exist, or vice versa, as in the above exam- 
ples. We shall see later that for some special matrices, 


AB=BA (B.57) 


When Eq. (B.57) is true, matrices A and B are said to commute. We must stress 
here again that in general, matrices do not commute. Operation (B.57) is valid only 
for some special cases. 

In the matrix product AB, matrix A is said to be postmultiplied by B or 
matrix B is said to be premultiplied by A. We may also verify the following 
relationships: 


(A+B)C=AC+BC (B.58) 
C(A +B) = CA +CB (B.59) 


We can verify that any matrix A premultiplied or postmultiplied by the identity 
matrix I remains unchanged: 
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AI=IA=A (B.60) 


Of course, we must make sure that the order of I is such that the matrices aré 
conformable for the corresponding product. 


4. Multiplication of a Matrix by a Vector 


Consider the matrix Eq. (B.52), which represents Eq. (B.48). The right-hand 
side of Eq. (B.52) is a product of the m x n matrix A and a vector x. If, for the 
time being, we treat the vector x as if it were an n x 1 matrix, then the product 
Ax, according to the matrix multiplication rule, yields the right-hand side of Eq. 
(B.48). Thus, we may multiply a matrix by a vector by treating the vector as if it 
were an nx 1 matrix. Note that the constraint of conformability still applies. Thus, 
in this case, xA is not defined and is meaningless. 


5. Matrix Inversion 


To define the inverse of a matrix, let us consider the set of equations 


yı Qiu Q12 ° Gin Tı 
y2 a21 Q22 ‘*' An T2 
= (B.61) 
Yn Ani an2 *** Ann Tn 
We can solve this set of equations for £1, £2, -.. , Zn in terms of Y1, Yay +++ Yn by 
using Cramer’s rule [see Eq. (B.31)]. This yields 
Tat Dal .,, [Dm 
Tı j A yı 
T2 PH DH vee Deel z y2 
= (B.62) 


Din Dan) .,, [Dna 
Tn A Yn 


in which |A| is the determinant of the matrix A and [D,,| is the cofactor of element 
aij in the matrix A. The cofactor of element aj; is given by (-1)'+) times the 
determinant of the (n — 1) x (n — 1) matrix that is obtained when the ith row and 
the jth column in matrix A are deleted. 

We can express Eq. (B.61) in matrix form as 


y = Ax (B.63) 
We can now define A~}, the inverse of a square matrix A, with the property 
ATA=I (unit matrix) (B.64) 
Then, premultiplying both sides of Eq. (B.63) by A7!, we obtain 


Ally=AlAx=Ix=x 
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or 
x= Aly (B.65) 
A comparison of Eq. (B.65) with Eq. (B.62) shows that 


[Dul {Dal = [Dnil 

a 1 | rt [Daal --- [Daal 

A = Tal (B.66) 
IDin] [Dan] 22% \Dan| 


One of the conditions necessary for a unique solution of Eq. (B.61) is that the 
number of equations must equal the number of unknowns. This implies that the 
matrix A must be a square matrix. In addition, we observe from the solution as 
given in Eq. (B.62) that if the solution is to exist, |A] # 0.t Therefore, the inverse 
exists only for a square matrix and only under the condition that the determinant 
of the matrix be nonzero. A matrix whose determinant is nonzero is a nonsin- 
gular matrix. Thus, an inverse exists only for a nonsingular (square) matrix. By 
definition, we have 


ATA=I (B.67a) 


Postmultiplying this equation by A~! and then premultiplying by A, we can show 
that 


AAS =I (B.67b) 


Note that the matrices A and A~! commute. 


@ Example B.12 
Let us find AW? if 


Here 
[Dul =-4, [Diz] =8, |Dis| = —4 


\Dal=1, [De2]=—-1, [Des] =—-1 


|Dai]=1, {Ds2e}=—-5, |Dss| = 3 
and |A| = —4. Therefore, 


-4 1 1 
ee eee 5 E 
4 
-4 -1 3 


{These two conditions imply that the number of equations is equal to the number of unknowns 
and that all the equations are independent. 
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B.6-3 Derivatives and Integrals of a Matrix 


Elements of a matrix need not be constants; they may be functions of a variable. 


For example, if : 
e7% sin t 
A= (B.68) 


et et + e72t 


then the matrix elements are functions of ¢. Here, it is helpful to denote A by A(t). 
Also, it would be helpful to define the derivative and integral of A(t). 

The derivative of a matrix A(t) (with respect to t) is defined as a matrix whose 
ijth element is the derivative (with respect to t) of the ijth element of the matrix 
A. Thus, if 


A(t) = laiz (t)]mxn 
then : 
taco] = [Fost] (B.69a) 
or 
A(t) = [44j(t)]mxn (B.69b) 
Thus, the derivative of the matrix in Eq. (B.68) is given by 
: —2e7?t cos t 
A(t) = 
et —e~t — 2e7% 


Similarly, we define the integral of A(t) (with respect to t) as a matrix whose 
ijth element is the integral (with respect to t) of the ijth element of the matrix A: 


[aw dt = (fase a) (B.70) 


Thus, for the matrix A in Eq. (B.68), we have 
fe dt f sin dt 
f A(t)dt = 
fetdt f(et+ 2e~**) dt 


We can readily prove the following identities: 


£ ae B.71 
ae ae ae (B.T1a) 
d dA 
EEN i B.71b 
Ai rT ( ) 
B ` F 
4 ap) = “4B+ a2 = AB+AB (B.71c) 


dt dt 
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The proofs of identities (B.71a) and (B.71b) are trivial. We can prove Eq. (B.71c) 
as follows. Let A be an m x n matrix and B an n x p matrix. Then, if 

C=AB 
from Eq. (B.56), we have 


n 


Cik = Y aijbjr 


j-l 
and 
n n 
ik = Z åijbjk + D aijbjk (B.72) 
j-1 j-1 
See’ 
dik Cik 

or 


ċij = dij + eik 


Equation (B.72) along with the multiplication rule clearly indicate that dix is the 
ikth element of matrix AB and e,, is the ikth element of matrix AB. Equation 
(B.71c) then follows. 

If we let B = A7! in Eq. (B.71c), we obtain 


d dA d 
—(AA7!) = ZAT! ZAT! 
TOA Sa TARS 
But since 
dn d 
i (AA) = a! =0 
we have 
daah -14A -1 
gAn s=-A A (B.73) 


B.6-4 The Characteristic Equation of a Matrix: The Cayley-Hamilton 
Theorem 


For an (n x n) square matrix A, any vector x (x # 0) that satisfies the equation 
Ax = Ax (B.74) 


is an eigenvector (or characteristic vector), and À is the corresponding eigen- 
value (or characteristic value) of A. Equation (B.74) can be expressed as 


(A — AI)x = 0 (B.75) 
The solution for this set of homogeneous equations exists if and only if 


|A — AI = |AT— A] =0 (B.76a) 


or 
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ay —-A a12 nee Gin 
a21 ag2-A n azn i 
=0 (B.76b) 
ünl an2 +++) Gnn — A 


Equation (B.76a) [or (B.76b)] is known as the characteristic equation of the 
matrix A and can be expressed as 


QQ) =AL- Al =A" tap" + Fad + aà? = 0 (B.77) 


Q()) is called the characteristic polynomial of the matrix A. The n zeros of 
the characteristic polynomial are the eigenvalues of A and, corresponding to each 
eigenvalue, there is an eigenvector that satisfies Eq. (B.74). 

The Cayley-Hamilton theorem states that every n x n matrix A satisfies 
its own characteristic equation. In other words, Eq. (B.77) is valid if À is replaced 
by A: 


Q(A) = A” + an-1A"™ + ta,A+apA° =0 (B.78) 


Functions of a Matrix 


The Cayley-Hamilton theorem can be used to evaluate functions of a square 
matrix A, as shown below. 
Consider a function f(A) in the form of an infinite power series: 


o0 
fA) Sag tard tagt te= Dad? (B.79) 
i=0 


Because 2 satisfies the characteristic Eq. (B.77), we can write 


A? = —an-1A™ 1! - TAES — .— aÀ — a9 (B.80) 


If we multiply both sides by à, the left-hand side is \"*?, and the right-hand side 
contains the terms à”, A"~!,... , A. Using Eq. (B.80), if we substitute A” in terms 
of Av—1, APT? ... , A, the highest power on the right-hand side is reduced to n — 1. 
Continuing in this way, we see that y+ can be expressed in terms of Aa ARS S, 
..., A for any k. Hence, the infinite series on the right-hand side of Eq. (B.79) can 


always be expressed in terms of A71, APF, 1. A as 
f(A) = Bo + Bid + Bad? +++ + Bnd (B.81) 
If we assume that there are n distinct eigenvalues Aj, 42, .-- 1 An: then Eq. (B.81) 


holds for these n values of à. The substitution of these values in Eq. (B.81) yields 
n simultaneous equations 
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fA) 1 A A? Ae Bo 
f(A2) 1 oaz AR oe ART | A 
= (B.82a) 
f (An) 1 An AR vs ART LBn-1 
and 
Bo 1o AR ere ARTI OD 
By Loz AB oe ART? £(A2) 
= (B.82b) 
Bn-1 1 An 2 EAS jpa Fn) 


Since A also satisfies Eq. (B.80), we may advance a similar argument to show that 
if f(A) is a function of a square matrix A expressed as an infinite power series in 
A, then 


[oe] 
f(A) = aol +aA tag? tte = A aA (B.83a) 
i=0 
and 
f(A) = Bol + BiA + BoA? +-+ + bn-1 A" (B.83b) 


in which the coefficients £;s are found from Eq. (B.82b). If some of the eigenvalues 
are repeated (multiple roots), the results are somewhat modified. 
We shall demonstrate the utility of this result with the following two examples. 


B.6-5 Computation of an Exponential and a Power of a Matrix 


Let us compute e“* defined by 


A??? A™ 
eAt—- [4+ At + = +t 


2! n! 
= I 
aa k! 


+e‘ 


From Eq. (B.83b), we can express 
n-1 ; 
et = ai Bi(A)* 
i=1 


in which the £;s are given by Eq. (B.82b), with f(s) = et. 


oe ee a- 


B.6 Vectors and Matrices 45 


BB Example B.13 
Let us consider the case where 


The eigenvalues are 


à =l 


DI- Al = =)? 43d42=(A+F1)(AF2) =0 


A+3 


Hence, \1 = —1, A2 = —2, and 


e™ = fol + ĝ1A 


in which 


and 
-t _ 72t -t _ 72t 
4 | 2e e (e e d Bi 


Computation of AF 


As Eq. (B.83b) indicates, we can express AF as 
AF = Bol + BA + + Bra" 


in which the @;s are given by Eq. (B.82b) with f(Ai) = A£. For a completed exampk 
of the computation of A* by this method, see Example 13.12. 


46 Background 


B.7 Miscellaneous 


B.7-1 L'Hépital’s Rule 


If lim f (x)/g(x) results in the indeterministic form 0/0 or co/oo, then 


fim £2) = tim £@) 


m 
a@) ae) 
B.7-2 The Taylor and Maclaurin Series 


(z-a); (z-a? ; 
=A) f(a) + ESA ta) + 


f(z) = f(a) + 


“nu: z? . 
f(a) = 0) + GIO + FAO + 


B.7-3 Power Series 


z? z3 r” 
z= pe y E N E A 
e =i+r+ ytt togt 
; = a a zg? 
sn z=2@—- 31 a 

2 4 6 8 
dara eh es a a eat 


2 4al ol 8 


t = — + — de Secs 2 2 
an g z+- +g t gig z? < 71*/4 
3 5 7 
z 2x 17z 
tanh z = t — — PPOR EE EE EA 2 2 
anhr=r PAET: 315 | z? < n*/4 


2! 


Si ~1\(n—- 
tralaren MON ey MODE a a (Pate 


k 
witne lzi & 1 


=1+a+r? +r t lz|< 1 

l-« 

B.7-4 Sums 
k k+l _y 
yor = I rl 
m=0 3 
N N+1 _,.M 
ym rr! 
m=M tas 
k anm g kth pet} 
2 G) bF(a — b) oe 
m=0 
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B.7-5 Complex Numbers 


eti"? = +j 
etme = f! neven 
—1 nodd 
eti? = cos 0 + j sin 0 
a+ jo = re? r= Va? + b?, 8 = tan! (2) 
(rei?) = reik? 


(riet) (rze???) 2 ryrged (1482) 
B.7-6 Trigonometric Identities 


eti? = cos z + jsin z 

cos z = bfe?" + e 7] 

sin z = Hle” | 

cos (z + $) = ¥sin z 

sin (x + $) = £cos z 

2sin z cos x = sin 2z 

sin? z + cos? z = 1 

cos? z — sin? z = cos 2x 

cos? s = (1 + cos 2x) 

sin? z = 3(1 — cos 2x) 

cos? z = }(3 cos z + cos 32) 

sin? z = $ (3sin z ~ sin 3x) 
sin (z + y) = sin z cos y + cos rsin y 
cos (x + y) = cos z CoS y F sin z sin y 


tan (z +y) = tanzttany 
1 F tan z tan y 

sin z sin y = [cos (x — y) — cos (z+y) 

cos z cos y = $[cos (z — y) + cos (z + y)| 

sin z cos y = ġļsin (z — y) + sin (z +y) 


acos z + bsin z = C cos (x£ + 0) 


—b 
in which C = Va? +b? and 0 = tan7! (=) 
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B.7-7 


Background 


Indefinite Integrals 
few=w- foa 
[ s)at@as = ose- [i@oea: 
J : 1 i 1, 
sin az dz = —— COS az cos az dz = ~ sin ax 
a a 
2 x sin ĉar 2 z sin daz 
dz = - - —— dr = — 
[om az dz 5 Ta [os ax az z + ia 
T 
asin az dgr = <a (sin ax — ax cos az) 
1 : 
z cos ax dz = ~z (cos az + az sin az) 
a 
2: 1 : 22 
z“ sin ardz = ga (Zax sin az + 2cos az — az“ cos az) 
2 1 A 2,2 9 
x“ cos az dt = gee cos ax — 2sin az + a°s* sin az) 
; A sin(a—b)z sin (a +b)z 21,2 
sin az sin bz dx = ———— - -a nT b 
f 7 meee 2(a — b) 2(a +b) oF 
[sin ax cos bade =- cos(a — b)z , cos(a + b)z a2 fb? 
2(a — b) 2(a +b) 
[es az cos br dz = cca al A abe a (a + b)z a? £ b? 
2(a — b) 2(a +b) 


® 
Q 
& 
A 
8 
i 
[l 
o 


ett 
ze"? dr = Ga (ae -1) 


2,an e7, 22 
re dz = —(a"s — 2ax + 2) 


ax 
e* sin ba dz = 


270 (asin bz — bcos bz) 
a 


az 


a? +b? 
1 1 z 
——— dr =- tan! = 
|a Tea 


|r = 5 In(2? +a’) 


r? +a? 


e** cos br dz = 


(acos bz + bsin bx) 


Shes Be Re Sa, 
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B.7-8 Differentiation Table 


d d, du d ys ` 
= £ fE Labe = b(lna)a?” 
ae?) qui) dz oP (na)a 
4 (uv) au + E sin az cos ax 
a = pated ell Sa 
da “de de dz 
_ ,, dv 
a (%) n Yas Nas — cos az = —asin az 
dz \v v? dz 
n 
d 

dr” = ng”! — tan ar = ts 
dz dz cos? az 

1 (es a 
— In(azr) = z g| az) = 

loge d a = —a 
—_ log(az) = Eu P (08 az) = Wi ate 
d bs _ pebr d E E 
da. me dz (tan =ar):= 1+ a?r? 


B.7-9 Some Useful Constants 
m =~ 3.1415926535 
e =~ 2.717182818284 
1 æ 0.3678794411 
logy9 2 = 0.30103 
logio 3 = 0.47712 


B.7-10 Solution of Quadratic and Cubic Equations 
Any quadratic equation can be reduced to the form 
az? +br+c=0 


The solution of this equation is provided by 


= —b + Vb? — 4ac 
g 2a 


zT 
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A general cubic equation 
y? +py? +qytr=0 
may be reduced to the depressed cubic form 
e+act+b=0 


by substituting 
y=r-§ 


This yields 
a= 3(3q — p?) b= 2 (2p? — 9pq + 27r) 


Now let 


The solution of the depressed cubic is 


254+B, 2a Ag 4 478V, = ASB AGB VM 
and 

y=r-§ 
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Se oe 


Introduction to Signals 
and Systems 


In this chapter we shall discuss certain basic aspects of signals. We shall also 
introduce important basic concepts and qualitative explanations of the how’s and 
why’s of systems theory, thus building a solid foundation for understanding the 
quantitative analysis in the remainder of the book. 


Signals 


A signal, as the term implies, is a set of information or data. Examples include 
a telephone or a television signal, monthly sales of a corporation, or the daily closing 
prices of a stock market (e.g., the Dow Jones averages). In all these examples, the 
signals are functions of the independent variable time. This is not always the case, 
however. When an electrical charge is distributed over a body, for instance, the 
signal is the charge density, a function of space rather than time. In this book 
we deal almost exclusively with signals that are functions of time. The discussion, 
however, applies equally well to other independent variables. 


Systems 


Signals may be processed further by systems, which may modify them o 
extract additional information from them. For example, an antiaircraft gun operato! 
may want to know the future location of a hostile moving target that is being trackec 
by his radar. Knowing the radar signal he knows the past location and velocity o 
the target. By properly processing the radar signal (the input) he can approximately 
estimate the future location of the target. Thus, a system is an entity that processe: 
a set of signals (inputs) to yield another set of signals (outputs). A system may bı 
made up of physical components, as in electrical, mechanical, or hydraulic system: 
(hardware realization), or it may be an algorithm that computes an output fron 
an input signal (software realization). 
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1.1 Size of a Signal 


The size of any entity is a number that indicates the largeness or strength of 
that entity. Generally speaking, the signal amplitude varies with time. How can a 
signal that exists over a certain time interval with varying amplitude be measured 
by one number that will indicate the signal size or signal strength? Such a measure 
must consider not only the signal amplitude, but also its duration. For instance, if 
we are to devise a single number V as a measure of the size of a human being, we 
must consider not only his or her width (girth), but also the height. If we make a 
simplifying assumption that the shape of a person is a cylinder of variable radius r 
(which varies with the height h) then a reasonable measure of the size of a person 
of height H is the person’s volume V, given by 


H 
V= f r?(h)dh 
0 


Signal Energy 


Arguing in this manner, we may consider the area under a signal f(t) as a 
possible measure of its size, because it takes account of not only the amplitude, but 
also the duration. However, this will be a defective measure because f(t) could be 
a large signal, yet its positive and negative areas could cancel each other, indicating 
a signal of small size. This difficulty can be corrected by defining the signal size 
as the area under f(t), which is always positive. We call this measure the signal 
energy Eş, defined (for a real signal) as 


Ey= a f?(t) dt (1.1) 


This definition can be generalized to a complex valued signal f(t) as 


ens] 

Eş -f [f(t)|? at (1.2) 
—oo 

There are also other possible measures of signal size, such as the area under |f (¢)]. 

The energy measure, however, is not only more tractable mathematically, but is 

also more meaningful (as shown later) in the sense that it is indicative of the energy 

that can be extracted from the signal. 


Signal Power 


The signal energy must be finite for it to be a meaningful measure of the signal 
size. A necessary condition for the energy to be finite is that the signal amplitude 
— 0 as |t| + oo (Fig. 1.la). Otherwise the integral in Eq. (1.1) will not converge. 

In some cases, for instance, when the amplitude of f (t) does not — 0 as |t| — oo 
(Fig. 1.1b), then, the signal energy is infinite. A more meaningful measure of the 
signal size in such a case would be the time average of the energy, if it exists. This 
measure is called the power of the signal. For a signal f(t), we define its power Py 
as 


1/7? 
P;= jim = Jas (t) dt (1.3) 
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f) 
(a) 


(t) 
(b) 


Fig. 1.1 Examples of Signals: (a) a signal with finite energy (b) a signal with finite 
power. 


We can generalize this definition for a complex signal f(t) as 
maJ” t)|? dt (1.4) 
P= jim = f ma Ol 


Observe that the signal power P; is the time average (mean) of the signal amplitude 
squared, that is, the mean-squared value of f (t). Indeed, the square root of Py is 
the familiar rms (root mean square) value of f(t). 

The mean of an entity averaged over a large time interval approaching infinity 
exists if the entity is either periodic or has a statistical regularity. If such a condition 
is not satisfied, the average may not exist. For instance, a ramp signal f (t) =t 
increases indefinitely as |t| > 90, and neither the energy nor the power exists for 
this signal. 


Comments 

The signal energy as defined in Eq. (1.1) or Eq. (1.2) does not indicate the 
actual energy of the signal because the signal energy depends not only on the signal, 
but also on the load. It can, however, be interpreted as the energy dissipated in a 
normalized load of a 1-ohm resistor if a voltage f(t) were to be applied across the 
1-ohm resistor (or if a current f(t) were to be passed through the 1-ohm resistor). 
The measure of “energy” is, therefore indicative of the energy capability of the 
signal and not the actual energy. For this reason the concepts of conservation of 
energy should not be applied to this “signal energy”. Parallel observation applies 
to “signal power” defined in Eq. (1.3) or (1.4). These measures are but convenient 
indicators of the signal size, which prove useful in many applications. For instance, il 
we approximate a signal f(t) by another signal g(t), the error in the approximation 
is e(t) = f(t) — g(t). The energy (or power) of e(t) is a convenient indicator of 
the goodness of the approximation. It provides us with a quantitative measure ol 
determining the closeness of the approximation. In communication systems, during 
transmission over a channel, message signals are corrupted by unwanted signals 
(noise). The quality of the received signal is judged by the relative sizes of the 
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24 ft) 


Fig. 1.2 Signals for Example 1.1. 


desired signal and the unwanted signal (noise). In this case the ratio of the message 
signal and noise signal powers (signal to noise power ratio) is a good indication of 
the received signal quality. 


Units of Energy and Power: Equations (1.1) and (1.2) are not correct dimen- 
sionally. This is because here we are using the term energy not in its conventional 
sense, but to indicate the signal size. The same observation applies to Eqs. (1.3) 
and (1.4) for power. The units of energy and power, as defined here, depend on 
the nature of the signal f(t). If f(t) is a voltage signal, its energy Ey has units of 
Vg (volts squared-seconds) and its power Py has units of V? (volts squared). If 
f(t) is a current signal, these units will be A*s (amperes squared-seconds) and A? 
(amperes squared), respectively. 


E Example 1.1 
Determine the suitable measures of the signals in Fig 1.2. 


In Fig. 1.2a, the signal amplitude — 0 as |t| — oo. Therefore the suitable measure 
for this signal is its energy Ey given by 


o0 0 OO 
z= f fr(dt= oas | 4e*' dt =4+4=8 
-oo -1 0 


In Fig. 1.2b, the signal amplitude does not — 0 as |t| — co. However, it is periodic, and 
therefore its power exists. We can use Eq. (1.3) to determine its power. We can simplify 
the procedure for periodic signals by observing that a periodic signal repeats regularly 
each period (2 seconds in this case). Therefore, averaging f?(t) over an infinitely large 
interval is identical to averaging this quantity over one period (2 seconds in this case). 
Thus 


Recall that the signal power is the square of its rms value. Therefore, the rms value of 
this signal is 1/3. a 
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@ Example 1.2 

Determine the power and the rms value of 

(a) f(t) =C cos(wot +0) (b) f(t) = Ci cos (unt +61) +C2 cos (wat + 62) (wi # w2), 
(c) f(t) = Dei". 

(a) This is a periodic signal with period To = 27/wo. The suitable measure of this 
signal is its power. Because it is a periodic signal, we may compute its power by averaging 
its energy over one period To = 2r /wo. However, for the sake of demonstration, we shall 
solve this problem by averaging over an infinitely large time interval using Eq (1.3). 


T/2 c? T/2 
Py = lim = f C? cos? (wot + 8) dt = ulin 3T [1 + cos (2wot + 26)] dt 


T>oT Jr oT Joi 
2 T/2 2 ù[T/2 

= lim => dt+ lim =, cos (2wot + 26) dt 
T +00 -T/2 Toc 2T J_r/2 


The first term on the right-hand side is equal to C?/2. Moreover, the second term is zero 
because the integral appearing in this term represents the area under a sinusoid over a 
very large time interval T with T — oo. This area is at most equal to the area of half the 
cycle because of cancellations of the positive and negative areas of a sinusoid. The second 
term is this area multiplied by C?/2T with T —> oo. Clearly this term is zero, and 


2 


P; = a (1.5a) 


This shows that a sinusoid of amplitude C has a power C?/2 regardless of the value of its 
frequency wo (wo # 0) and phase 9. The rms value is C/V/2. If the signal frequency is zero 
(dc or a constant signal of amplitude C), the reader can show that the power is Ct. 


(b) In Chapter 4, we show that a sum of two sinusoids may or may not be periodic, 
depending on whether the ratio w1 /w2 is a rational number or not. Therefore, the period 
of this signal is not known. Hence, its power will be determined by averaging its energy 
over T seconds with T — oo. Thus, 


T/2 
Py = lim L {C1 cos (wit + 61) + C2 cos (wat + 02))? dt 
T-00 -T/2 


T/2 1 ft? 
= lim = Ci? cos? (wit + 61) dt + lim = C2? cos? (wat + 92) dt 
T>% T -T/2 T=% T -T/2 


T/2 
+ lim 20:02 / cos (wit + 61) cos (wat + 82) dt 
T= T: -T/2 


The first and second integrals on the right-hand side are the powers of the two sinusoids, 
which are C1?/2 and C2?/2 as found in part (a). Arguing as in part (a), we see that the 
third term is zero, and we havet 


P; = Sa += (1.5b) 


and the rms value is \/(C1? + C2)/2. 


We can readily extend this result to a sum of any number of sinusoids with distinct 
frequencies. Thus, if 


{This is true only if w1 # wo. If w, = we, the integrand of the third term contains a constant 
cos (6; — 92), and the third term — 2C1C2 cos (81 — 62) as T — œ. 
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(d) 


Fig. 1.3 Signals for Exercise E1.1. 


f(t) = X Cn cos (wnt + On) 


n=l 


where none of the two sinusoids have identical frequencies, then 


co 
Pp= 5 On? (1.5¢) 


n=l 
(c) In this case the signal is complex, and we use Eq. (1.4) to compute the power. 


1 fT? _, 
im F) |Dei“0*|? dt 


P; = B; 
RRR T/2 


Recall that |e7”°*| = 1 so that |Det“0t|? = |D|?, and 


P; = |D}? (1.5d) 
The rms value is |D|. W 


Comment: In part (b) we have shown that the power of the sum of two sinusoids 
is equal to the sum of the powers of the sinusoids. It appears that the power of 
filt) + fo(t) is Ps, + Pf. Unfortunately, this conclusion is not true in general. It 
is true only under a certain condition (orthogonality) discussed later in Sec. 3.1-3. 
A Exercise E1.1 

Show that the energies of the signals in Figs. 1.3a,b,c and d are 4, 1, 4/3, and 4/3, respec- 
tively. Observe that doubling a signal quadruples the energy, and time-shifting a signal has no 
effect on the energy. Show also that the power of the signal in Fig. 1.3e is 0.4323. What is the 
rms value of signal in Fig. 1.3e7 Yy 
A Exercise E1.2 

Redo Example 1.2a to find the power of a sinusoid C cos (wot + 6) by averaging the signal 
energy over one period To = 2r /wo (rather than averaging over the infinitely large interval). Show 
also that the power of a constant signal f(t) = Co is C2, and its rms value is Co. V 
A Exercise E1.3 

Show that if w1 = w2, the power of f(t) = Ci cos (wit + 61) + C2 cos (wat + 62) is [Ci? + 
Co? + 2C1C2 cos (61 — 62)]/2, which is not equal to (C1? +02?)/2. Vv 
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Fig. 1.4 Continuous-time and Discrete-time Signals. 


1.2 Classification of Signals 


There are several classes of signals. Here we shall consider only the following 
classes, which are suitable for the scope of this book: 


1. Continuous-time and discrete-time signals 
. Analog and digital signals 

. Periodic and aperiodic signals 

. Energy and power signals 

. Deterministic and probabilistic signals 


on Wh 


1.2-1 Continuous-Time and Discrete-Time Signals 


A signal that is specified for every value of time t (Fig. 1.4a) is a continuous- 
time signal, and a signal that is specified only at discrete values of t (Fig. 1.4b) is 
a discrete-time signal. Telephone and video camera outputs are continuous-time 
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f(t) f(t) 


a) (b) 


f(t) ttt f(t) 
e (c) (d) 


tr 


Fig. 1.5 Examples of Signals: (a) analog, continuous-time (b) digital, continuous-time 
(c) analog, discrete-time (d) digital, discrete-time. 


signals, whereas the quarterly gross national product (GNP), monthly sales of a 
corporation, and stock market daily averages are discrete-time signals. 


1.2-2 Analog and Digital Signals 


The concept of continuous-time is often confused with that of analog. The two 
are not the same. The same is true of the concepts of discrete-time and digital. A 
signal whose amplitude can take on any value in a continuous range is an analog 
signal. This means that an analog signal amplitude can take on an infinite number 
of values. A digital signal, on the other hand, is one whose amplitude can take 
on only a finite number of values. Signals associated with a digital computer are 
digital because they take on only two values (binary signals). A digital signal whose 
amplitudes can take on M values is an M-ary signal of which binary (M = 2) is 
a special case. The terms continuous-time and discrete-time qualify the nature of 
a signal along the time (horizontal) axis. The terms analog and digital, on the 
other hand, qualify the nature of the signal amplitude (vertical axis). Figure 1.5 
shows examples of various types of signals. It is clear that analog is not necessarily 
continuous-time and digital need not be discrete-time. Figure 1.5c shows an example 
of an analog discrete-time signal. An analog signal can be converted into a digital 
signal [analog-to-digital (A/D) conversion] through quantization (rounding off), as 
explained in Sec. 5.1-3. 


1.2-3 Periodic and Aperiodic Signals 


A signal f(t) is said to be periodic if for some positive constant To 


f(t) = f(t + To) for all t (1.6) 
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Fig. 1.6 A periodic signal of period To. 


The smallest value of To that satisfies the periodicity condition (1.6) is the period 
of f(t). The signals in Figs. 1.2b and 1.3e are periodic signals with periods 2 and 1, 
respectively. A signal is aperiodic if it is not periodic. Signals in Figs. 1.2a, 1.3a, 
1.3b, 1.3c, and 1.3d are all aperiodic. 

By definition, a periodic signal f (t) remains unchanged when time-shifted by 
one period. For this reason a periodic signal must start at t = —00 because if it 
starts at some finite instant, say t = 0, the time-shifted signal f(t+To) will start at 
t = —Tp and f(t + To) would not be the same as f(t). Therefore a periodic signal, 
by definition, must start at t = —00 and continuing forever, as illustrated in Fig. 
1.6. 

Another important property of a periodic signal f(t) is that f(t) can be gen- 
erated by periodic extension of any segment of f(t) of duration To (the period). 
As a result we can generate f(t) from any segment of f(t) with a duration of one 
period by placing this segment and the reproduction thereof end to end ad infini- 
tum on either side. Figure 1.7 shows a periodic signal f(t) of period To = 6. The 
shaded portion of Fig. 1.7a shows a segment of f(t) starting at t = —1 and having 
a duration of one period (6 seconds). This segment, when repeated forever in either 
direction, results in the periodic signal f (t). Figure 1.7b shows another shaded 
segment of f(t) of duration To starting at t = 0. Again we see that this segment, 
when repeated forever on either side, results in f(t). The reader can verify that this 
construction is possible with any segment of f(t) starting at any instant as long as 
the segment duration is one period. 

It is helpful to label signals that start at t = —0o and continue for ever as 
everlasting signals. Thus, an everlasting signal exists over the entire interval —co < 
t < oo. The signals in Figs. 1.1b and 1.2b are examples of everlasting signals. 
Clearly, a periodic signal, by definition, is an everlasting signal. 

A signal that does not start before t = 0 is a causal signal. In other words, 
f(t) is a causal signal if 


f(t)=0 t<0 (1.7) 


Signals in Figs. 1.3a, b, c, as well as in Figs. 1.9a and 1.9b are causal signals. A 
signal that starts before t = 0 is a noncausal signal. All the signals in Figs. 1.1 
and 1.2 are noncausal. Observe that an everlasting signal is always noncausal but 
a noncausal signal is not necessarily everlasting. The everlasting signal in Fig. 1.2b 
is noncausal; however, the noncausal signal in Fig. 1.2a is not everlasting. A signal 
that is zero for all t > 0 is called an anticausal signal. 
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(b) 


Fig. 1.7 Generation of a periodic signal by periodic extension of its segment of one-period 
duration. 


Comment: 

A true everlasting signal cannot be generated in practice for obvious reasons. 
Why should we bother to postulate such a signal? In later chapters we shall see 
that certain signals (including an everlasting sinusoid) which cannot be generated 
in practice do serve a very useful purpose in the study of signals and systems. 


1.2-4 Energy and Power Signals 


A signal with finite energy is an energy signal, and a signal with finite and 
nonzero power is a power signal. Signals in Fig. 1.2a and 1.2b are examples of 
energy and power signals, respectively. Observe that power is the time average of 
energy. Since the averaging is over an infinitely large interval, a signal with finite 
energy has zero power, and a signal with finite power has infinite energy. Therefore, 
a signal cannot both be an energy and a power signal. If it is one, it cannot be 
the other. On the other hand, there are signals that are neither energy nor power 
signals. The ramp signal is such an example. 


Comments 


All practical signals have finite energies and are therefore energy signals. A 
power signal must necessarily have infinite duration; otherwise its power, which is 
its energy averaged over an infinitely large interval, will not approach a (nonzero) 
limit. Clearly, it is impossible to generate a true power signal in practice because 
such a signal has infinite duration and infinite energy. 

Also, because of periodic repetition, periodic signals for which the area under 
|f (t)|? over one period is finite are power signals; however, not all power signals are 
periodic. 


A Exercise E1.4 

Show that an everlasting exponential e~°* is neither an energy nor a power signal for any 
real value of a. However, if a is imaginary, it is a power signal with power Py = 1 regardless of 
the value ofa. Y 


1.2-5 Deterministic and Random Signals 


A signal whose physical description is known completely, either in a mathemat- 
ical form or a graphical form, is a deterministic signal. A signal whose values 
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(a) 
o(t) = f(t-T) 


f(t+T) 


x T= (c) 


Fig. 1.8 Time shifting a signal. 


cannot be predicted precisely but are known only in terms of probabilistic descrip- 
tion, such as mean value, mean squared value, and so on is a random signal. In 
this book we shall exclusively deal with deterministic signals. Random signals are 
beyond the scope of this study. 


1.3 Some Useful Signal Operations 


We discuss here three useful signal operations: shifting, scaling, and inversion. 
Since the independent variable in our signal description is time, these operations are 
discussed as time shifting, time scaling, and time inversion (or folding). However, 
this discussion is valid for functions having independent variables other than time 
(e.g., frequency or distance). 


1.3-1 Time Shifting 


Consider a signal f(t) (Fig. 1.8a) and the same signal delayed by T seconds 
(Fig. 1.8b), which we shall denote by ¢(¢). Whatever happens in f(t) (Fig. 1.8a) at 
some instant t also happens in ¢(t) (Fig. 1.8b) T seconds later at the instant t + T'. 
Therefore 


o(t+T) = f(t) (1.8) 


o(t) = f(t-T) (1.9) 


Therefore, to time-shift a signal by T, we replace t with t — T. Thus f(t -T) 
represents f(t) time-shifted by T seconds. If T is positive, the shift is to the right 
(delay). If T is negative, the shift is to the left (advance). Thus, f(t- 2) is f(t) 
delayed (right-shifted) by 2 seconds, and f(t + 2) is f (t) advanced (left-shifted) by 
2 seconds. 


and 
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e721) 


f(t+#1) 


en dt +1) 


Fig. 1.9 (a) signal f(t) (b) f(t) delayed by 1 second (c) f(t) advanced by 1 second. 


| Example 1.3 

An exponential function f(t) = e7** shown in Fig. 1.9a is delayed by 1 second. Sketch 
and mathematically describe the delayed function. Repeat the problem if f(t) is advanced 
by 1 second. 

The function f(t) can be described mathematically as 


et t>0 F 
= 1. 
He) ts at (1.10) 


—2t 


Let fa(t) represent the function f(t) delayed (right-shifted) by 1 second as illustrated in 
Fig. 1.9b. This function is f(t — 1); its mathematical description can be obtained from 
f(t) by replacing t with t — 1 in Eq. (1.10). Thus 


e72(t-1) t-1>0 or t>1 
falt) = f(t- 1) -{ (1.11) 
0 #-1<0 or t<l 
Let fa(t) represent the function f(t) advanced (left-shifted) by 1 second as depicted in Fig. 
1.9c. This function is f(t + 1); its mathematical description can be obtained from f(t) by 
replacing t with £ + 1 in Eq. (1.10). Thus 


e72t+)) t+1>0 or t>-1 
falt) = f(t+1)= (1.12) 
0 t+1<0 or t< -l1 


A Exercise E1.5 

Write a mathematical description of the signal f3(t) in Fig. 1.3c. This signal is delayed 
by 2 seconds. Sketch the delayed signal. Show that this delayed signal fy(t) can be described 
mathematically as fy(t) = 2(t — 2) for 2 < t < 3, and equal to 0 otherwise. Now repeat the 
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(a) 


(b) 


Fig. 1.10 Time scaling a signal. 


procedure if the signal is advanced (left-shifted) by 1 second. Show that this advanced signal fa(t) 
can be described as fa(t) = 2(t + 1) for —1 <t < 0, and equal to 0 otherwise. 7 


1.3-2 Time Scaling 


The compression or expansion of a signal in time is known as time scaling. 
Consider the signal f(t) of Fig. 1.10a. The signal ¢(t) in Fig. 1.10b is f(t) com- 
pressed in time by a factor of 2. Therefore, whatever happens in f(t) at some 
instant t also happens to ¢(t) at the instant t/2, so that 


(5) = f(t) (1.13) 
and 

o(t) = f(2t) (1.14) 
Observe that because f(t) = 0 at t = Tı and T2, we must have ¢(t) = 0 att = 7)/2 
and T2/2, as shown in Fig. 1.10b. If f(t) were recorded on a tape and played back 


at twice the normal recording speed, we would obtain f(2t). In general, if f(t) is 
compressed in time by a factor a (a > 1), the resulting signal ¢(t) is given by 


$(t) = f (at) (1.15) 
Using a similar argument, we can show that f(t) expanded (slowed down) in 
time by a factor a (a > 1) is given by 


olt) = f (4) (1.16) 


Figure 1.10c shows f (8), which is f(t) expanded in time by a factor of 2. Observe 
that in time scaling operation, the origin t = 0 is the anchor point, which remains 
unchanged under scaling operation because at t = 0, f(t) = f(at) = f(0). 

In summary, to time-scale a signal by a factor a, we replace t with at. Ifa > 1, 
the scaling results in compression, and if a < 1, the scaling results in expansion. 
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f(t) 


Fig. 1.11 (a) signal f(t) (b) signal f(3¢) (c) signal f(§). 


E Example 1.4 

Figure 1.11a shows a signal f(t). Sketch and describe mathematically this signal 
time-compressed by factor 3. Repeat the problem for the same signal time-expanded by 
factor 2. 

The signal f(t) can be described as 


2 -15<t<0 
f(t) =< 2e*/? 0<t<3 (1.17) 
0 otherwise 


Figure 1.11b shows f.(t), which is f (t) time-compressed by factor 3; consequently, it can 
be described mathematically as f(3t), which is obtained by replacing t with 3t in the 
right-hand side of Eq. 1.17. Thus 


2 ~15<3t<0 or —05<t<0 
felt) = f(3t) = ¢ 267%? 0<3t<3 or 0<t<l (1.18a) 
0 otherwise 


Observe that the instants t = —1.5 and 3 in f(t) correspond to the instants t = —0.5, and 
1 in the compressed signal f(3t). 

Figure 1.11c shows fe(t), which is f(t) time-expanded by factor 2; consequently, it 
can be described mathematically as f(t/2), which is obtained by replacing t with ¢t/2 in 
f(t). Thus 
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Fig. 1.12 Time inversion (reflection) of a signal. 


2 -15<$<0 or -3<t<0 
t 
fe(t) =f (5) =< 20 0<£<3 or 0<t<6 (1.18b) 
0 otherwise 


Observe that the instants t = —1.5 and 3 in f(t) correspond to the instants t = —3 and 6 
in the expanded signal f(£). Ml 


A Exercise E1.6 

Show that the time-compression by a factor n (n > 1) ofa sinusoid results in a sinusoid of the 
same amplitude and phase, but with the frequency increased n-fold. Similarly the time expansion 
by a factor n (n > 1) of a sinusoid results in a sinusoid of the same amplitude and phase, but with 
the frequency reduced by a factor n. Verify your conclusion by sketching a sinusoid sin 2¢ and the 
same sinusoid compressed by a factor 3 and expanded by a factor 2. Y 


1.3-3 Time Inversion (Time Reversal) 


Consider the signal f(t) in Fig. 1.12a. We can view f(t) as a rigid wire frame 
hinged at the vertical axis. To time-invert f(t), we rotate this frame 180° about the 
vertical axis. This time inversion or folding [the reflection of f (t) about the vertical 
axis] gives us the signal ¢(¢) (Fig. 1.12b). Observe that whatever happens in Fig. 
1.12a at some instant t also happens in Fig. 1.12b at the instant —t. Therefore 


$o(—t) = f(t) 
and 
olt) = f(-t) (1.19) 
Therefore, to time-invert a signal we replace t with —t. Thus, the time inversion of 
signal f(t) yields f(—t). Consequently, the mirror image of f(t) about the vertical 
axis is f(—t). Recall also that the mirror image of f(t) about the horizontal axis is 


— f(t). 
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12 f(t) 
e (a) 


t- 


Fig. 1.13 An example of time inversion. 


E Example 1.5 
For the signal f (t) illustrated in Fig. 1.13a, sketch f(—t), which is time inverted f(t). 
The instants — 1 and —5 in f(t) are mapped into instants 1 and 5 in f(—t). Because 
f(t) = et/?, we have f(—t) = e7*/?. The signal f(—t) is depicted in Fig. 1.13b. We can 
describe f(t) and f(—t) as 


et/? -1>t>-5 
f(t) = f 
0 otherwise 
and its time inverted version f(—t) is obtained by replacing t with —t in f(t) as 
et? -1>-t>-5 or 1<t<5 
f(-t)= f 
0 otherwise a 


1.3-4 Combined Operations 


Certain complex operations require simultaneous use of more than one of the 
above operations. The most general operation involving all the three operations is 
f(at — b), which is realized in two possible sequences of operation: 


1. Time-shift f(t) by b to obtain f(t—b). Now time-scale the shifted signal f (t—b) 
by a (that is, replace t with at) to obtain f(at — b). 

2. Time-scale f(t) by a to obtain f (at). Now time-shift f (at) by 8 (that is, replace 
t with (t — b) to obtain f [a(t — 2)] = f (at — b). In either case, if a is negative, 
time scaling involves time inversion. 

For instance, the signal f (2t — 6) can be obtained in two ways: first, delay f(t) 
by 6 to obtain f(t — 6) and then time-compress this signal by factor 2 (replace t 
with 2t) to obtain f(2t— 6). Alternately, we first time-compress f(t) by factor 2 to 
obtain f(2t), then delay this signal by 3 (replace t with t — 3) to obtain f(2¢ — 6). 


1.4 Some Useful Signal Models 


In the area of signals and systems, the step, the impulse, and the exponential 
functions are very useful. They not only serve as a basis for representing other 
signals, but their use can simplify many aspects of the signals and systems. 
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1 u(t) 
0 t — 
(a) (b) 


Fig. 1.14 (a) Unit step function u(t) (b) exponential e u(t). 


1. Unit Step Function u(t) 


In much of our discussion, the signals begin at t = 0 (causal signals). Such 
signals can be conveniently described in terms of unit step function u(t) shown in 
Fig. 1.14a. This function is defined by 


i pan 1.20 
u(t) = j 
© 0 t<0 ( 


If we want a signal to start at t = 0 (so that it has a value of zero for t < 0), we 
only need to multiply the signal with u(t). For instance, the signal et represents an 
everlasting exponential that starts at t = —oo. The causal form of this exponential 
illustrated in Fig. 1.14b can be described as e~*u/(t). 

The unit step function also proves very useful in specifying a function with 
different mathematical descriptions over different intervals. Examples of such func- 
tions appear in Fig. 1.11. These functions have different mathematical descriptions 
over different segments of time as seen from Eqs. (1.17), (1.18a), and (1.18b). Such 
a description often proves clumsy and inconvenient in mathematical treatment. Us- 
ing the unit step function, we can describe such functions by a single expression 
that is valid for all t. 


Fig. 1.15 Representation of a rectangular pulse by step functions. 


Consider, for example, the rectangular pulse depicted in Fig. 1.15a. We can 
express such a pulse in terms of familiar step functions by observing that the pulse 
f(t) can be expressed as the sum of the two delayed unit step functions as shown 
in Fig. 1.15b. The unit step function u(t) delayed by T seconds is u(t — T). From 
Fig. 1.15b, it is clear that 


f(t) = u(t -— 2) - u(t — 4) 
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Fig. 1.16 Representation of a signal defined interval by interval. 


E Example 1.6 

Describe the signal in Fig. 1.16a. 

The signal illustrated in Fig. 1.16a can be conveniently handled by breaking it up 
into the two components fi(t) and fa(t), depicted in Figs. 1.16b and 1.16c respectively. 
Here, fi(t) can be obtained by multiplying the ramp ¢ by the gate pulse u(t) — u(t — 2), 
as shown in Fig. 1.16b. Therefore 


fi(t) = t fult) ~ ult - 2)] 
The signal f2(t) can be obtained by multiplying another ramp by the gate pulse illustrated 
in Fig. 1.16c. This ramp has a slope —2; hence it can be described by —2t+c. Now, because 
the ramp has a zero value at t = 3, the constant c = 6, and the ramp can be described by 
—2(t — 3). Also, the gate pulse in Fig. 1.16c is u(t — 2) — u(t — 3). Therefore 
falt) = ~2(t — 3) [u(t — 2) — u(t - 3)] 


and 


f(t) = falt) + falt) 
= t [u(t) — u(t — 2)] — 2(¢ — 3) [u(t - 2) — u(t — 3)] 
= tu(t) — 3(t — 2)u(t — 2) + 2(t — 3)u(t — 3) a 
E Example 1.7 
Describe the signal in Fig. 1.11a by a single expression valid for all t. 
Over the interval from —1.5 to 0, the signal can be described by a constant 2, and 
over the interval from 0 to 3, it can be described by 2 e */?, Therefore 
f(t) = Ault + 1.5) — u(t) + 2e fult) — u(t — 3)] 
filt) fa(t) 
= Qu(t + 1.5) — 2(1 — e~*/?)u(t) - 2e “ule — 3) 
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u(-t) 


aed t — 


(a) (b) 
Fig. 1.17 The Signal for Exercise E1.7. 


f(t) 


Fig. 1.18 The signal for Exercise E1.8. 


Compare this expression with the expression for the same function found in Eq. 1.17. a 


A Exercise E1.7 
Show that the signals depicted in Figs. 1.17a and 1.17b can be described as u(~t), and 
e~%u(—t), respectively. J 
A Exercise E1.8 
Show that the signal shown in Fig. 1.18 can be described as 
f(t) =(t-Dult-1) -(- 2)u(t-2)-u(t-4) V 


2. The Unit Impulse Function 6(¢) 


The unit impulse function 6(t) is one of the most important functions in the 
study of signals and systems. This function was first defined by P. A. M Dirac as 


6(t) =0 t 40 


a 6(t)dt =1 (1.21) 


We can visualize an impulse as a tall, narrow rectangular pulse of unit area, 
as illustrated in Fig. 1.19b. The width of this rectangular pulse is a very small 
value e — 0. Consequently, its height is a very large value 1/e. The unit impulse 
therefore can be regarded as a rectangular pulse with a width that has become 
infinitesimally small, a height that has become infinitely large, and an overall area 
that has been maintained at unity. Thus 6(¢) = 0 everywhere except at t = 0, where 
it is undefined. For this reason a unit impulse is represented by the spear-like symbol 
in Fig. 1.19a. 

Other pulses, such as exponential pulse, triangular pulse, or Gaussian pulse 
may also be used in impulse approximation. The important feature of the unit 
impulse function is not its shape but the fact that its effective duration (pulse width) 
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Fig. 1.19 A unit impulse and its approximation. 
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Fig. 1.20 Other possible approximations to a unit impulse. 


approaches zero while its area remains at unity. For example, the exponential pulse 
ae™®tu(t) in Fig. 1.20a becomes taller and narrower as œ increases. In the limit as 
a — œ, the pulse height — oo, and its width or duration > 0. Yet, the area under 
the pulse is unity regardless of the value of a because 


oo 
J ae~%* dt =1 (1.22) 
0 


The pulses in Figs. 1.20b and 1.20c behave in a similar fashion. 
From Eq. (1.21), it follows that the function k6(t) = 0 for all t # 0, and its 


area is k. Thus, &6(t) is an impulse function whose area is k (in contrast to the unit 
impulse function, whose area is 1). 


Multiplication of a Function by an Impulse 


Let us now consider what happens when we multiply the unit impulse 6 (t) by 
a function ¢(t) that is known to be continuous at t = 0. Since the impulse exists 
only at t = 0, and the value of ¢(t) at t = 0 is ¢(0), we obtain 


(t)5(t) = $(0)6(E) (1.23a) 


Similarly, if (t) is multiplied by an impulse 6(t — T) (impulse located at t = T), 
then 


$(t)6(t - T) = o(T)6(t — T) (1.23b) 


provided ¢(t) is continuous at t = T, 
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Sampling Property of the Unit Impulse Function 
From Eq. (1.23a) it follows that 


h * ADEO at= 0) | » 5(4) at 
= $(0) (1.24a) 


provided ¢(t) is continuous at t = 0. This result means that the area under the 

product of a function with an impulse 6(t) is equal to the value of that function at 

the instant where the unit impulse is located. This property is very important and 

useful, and is known as the sampling or sifting property of the unit impulse. 
From Eq. (1.23b) it follows that 


Je $(t)6(t - T) dt = 4(T) (1.24b) 


Equation (1.24b) is just another form of sampling or sifting property. In the case 
of Eq. (1.24b), the impulse 6(t — T) is located at t = T. Therefore, the area under 
o(t)6(t — T) is 4(T), the value of ọ(t) at the instant where the impulse is located 
(at t = T). In these derivations we have assumed that the function is continuous 
at the instant where the impulse is located. 


Unit Impulse as a Generalized Function 


The definition of the unit impulse function given in Eq. (1.21) is not mathe- 
matically rigorous, which leads to serious difficulties. First, the impulse function 
does not define a unique function: for example, it can be shown that 6(t) + 6(t) 
also satisfies Eq. (1.21).1 Moreover, 6(t) is not even a true function in the ordinary 
sense. An ordinary function is specified by its values for all time t. The impulse 
function is zero everywhere except at t = 0, and at this only interesting part of its 
range it is undefined. These difficulties are resolved by defining the impulse as a 
generalized function rather than an ordinary function. A generalized function is 
defined by its effect on other functions instead of by its value at every instant of 
time. 

In this approach the impulse function is defined by the sampling property (Eq. 
(1.24)]. We say nothing about what the impulse function is or what it looks like. 
Instead, the impulse function is defined in terms of its effect on a test function 
e(t). We define a unit impulse as a function for which the area under its product 
with a function ¢(t) is equal to the value of the function 4(t) at the instant where 
the impulse is located. It is assumed that ¢(t) is continuous at the location of the 
impulse. Therefore, either Eq. (1.24a) or (1.24b) can serve as a definition of the 
impulse function in this approach. Recall that the sampling property [Eq. (1.24)] 
is the consequence of the classical (Dirac) definition of impulse in Eq. (1.21). In 
contrast, the sampling property [Eq. (1.24)] defines the impulse function in the 
generalized function approach. 

We now present an interesting application of the generalized function definition 
of an impulse. Because the unit step function u(t) is discontinuous at t = 0, its 
derivative du/dt does not exist at t = 0 in the ordinary sense. We now show that 
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this derivative does exist in the generalized sense, and it is, in fact, ô(t). As a proof, 
let us evaluate the integral of (du/dt)¢(t), using integration by parts: 


fo =) d oo pe f 
| wht = woo z J DHe) dt (1.25) 


= o(00)-0~ | idt 
= $(00) — glo 
= ¢(0) (1.26) 


This result shows that du/dt satisfies the sampling property of ô(t). Therefore it is 
an impulse ô(t) in the generalized sense—that is, 


e = ô(t) (1.27) 
Consequently 
f 6(r) dr = u(t) (1.28) 


These results can also be obtained graphically from Fig. 1.19b. We observe 
that the area from —oo to t under the limiting form of 6(¢) in Fig. 1.19b is zero if 
t < 0 and unity if t > 0. Consequently 


1 soars t<0 
-%0 1 t20 
= u(t) (1.29) 


Derivatives of impulse function can also be defined as generalized functions (see 
Prob. 1.4-10). 


A Exercise E1.9 


Show that 
(ay erana ©) [sn (P- 3) 5 = -8 
2 2 
(e) e7?86(t) = 6(t) @ 5 a sw 1) = 35 ~1) 
Hint: Use Eqs. (1.23). V7 
A Exercise E1.10 
Show that 
( f Sltje-it dt = 1 oœ 
a eae OF alt- 2)cos (=) de =o 


(e) f e722) §(2 — t) dt = e 208-9) 
=% 


Hint: In part c recall that 6(z) is located at z = 0. Therefore ô(2 — t) is located at 2 — t = 0; that 
isatt=2. 7 
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Fig. 1.21 Sinusoids of complex frequency o + jw. 


3. The Exponential Function e* 


One of the most important functions in the area of signals and systems is the 
exponential signal e**, where s is complex in general, given by 


s=otjw 
Therefore l 
est = eltio) = teit = e7t(cos wt + j sin wt) (1.30a) 


If s* =o — jw (the conjugate of s), then 
est = ei = ete iet = eft (cos wt — j sin wt) (1.30b) 


and 1 
e7* cos wt = ze” kest) (1.30c) 


Comparison of this equation with Euler’s formula shows that e% is a generalization 
of the function e%”*, where the frequency variable jw is generalized to a complex 
variable s = ø + jw. For this reason we designate the variable s as the complex 
frequency. From Eqs. (1.30) it follows that the function e%* encompasses a large 
class of functions. The following functions are special cases of et: 


1 A constant k = ke% (s = 0) 

2 A monotonic exponential e% (w = 0, s =ø) 

3 A sinusoid cos wt (¢ = 0, s = +jw) 

4 An exponentially varying sinusoid etcoswt (s=at jw) 
These functions are illustrated in Fig. 1.21. 

The complex frequency s can be conveniently represented on a complex fre- 
quency plane (s plane) as depicted in Fig. 1.22. The horizontal axis is the real axis 
(o axis), and the vertical axis is the imaginary axis (jw axis). The absolute value of 
the imaginary part of s is |w| (the radian frequency), which indicates the frequency 
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Exponentially decreasing signals 


Fig. 1.22 Complex frequency plane. 


of oscillation of e*t; the real part o (the neper frequency) gives information about 
the rate of increase or decrease of the amplitude of e**. For signals whose complex 
frequencies lie on the real axis (c-axis, where w = 0), the frequency of oscillation 
is zero. Consequently these signals are monotonically increasing or decreasing ex- 
ponentials (Fig. 1.21a). For signals whose frequencies lie on the imaginary axis (jw 
axis where ø = 0), e7t = 1. Therefore, these signals are conventional sinusoids with 
constant amplitude (Fig. 1.21b). The case s = 0 (øe = w = 0) corresponds to a 
constant (dc) signal because e® = 1. For the signals illustrated in Figs. 1.21c and 
1.21d, both o and w are nonzero; the frequency s is complex and does not lie on 
either axis. The signal in Fig. 1.21c decays exponentially. Therefore, o is negative, 
and s lies to the left of the imaginary axis. In contrast, the signal in Fig. 1.21d 
grows exponentially. Therefore, ø is positive, and s lies to the right of the imagi- 
nary axis. Thus the s-plane (Fig. 1.21) can be differentiated into two parts: the left 
half-plane (LHP) corresponding to exponentially decaying signals and the right 
half-plane (RHP) corresponding to exponentially growing signals. The imaginary 
axis separates the two regions and corresponds to signals of constant amplitude. 


An exponentially growing sinusoid e% cos (5t + 0), for example, can be ex- 
pressed as a sum of exponentials e(?+75)* and e(2-75)* with complex frequencies 
2+ 75 and 2 — j5, respectively, which lie in the RHP. An exponentially decaying 
sinusoid e~* cos (5t + 6) can be expressed as a sum of exponentials e(-?+45)* and 
e(-2-55)t with complex frequencies —2 + j5 and —2 — j5, respectively, which lie in 
the LHP. A constant amplitude sinusoid cos (5t+6) can be expressed as a sum of ex- 
ponentials e/** and e715 with complex frequencies +45, which lie on the imaginary 
axis. Observe that the monotonic exponentials e+”* are also generalized sinusoids 
with complex frequencies +2. 
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Fig. 1.23 An even and an odd function of t. 


1.5 Even and Odd Functions 
A function fe(t) is said to be an even function of t if 


fe(t) = fe(—t) (1.31) 


and a function f(t) is said to be an odd function of t if 


folt) = —fo(—t) (1.32) 


An even function has the same value at the instants t and —t for all values of t. 
Clearly, fe(t) is symmetrical about the vertical axis, as shown in Fig. 1.23a. On the 
other hand, the value of an odd function at the instant t is the negative of its value 
at the instant —t. Therefore, fo(t) is anti-symmetrical about the vertical axis, as 
depicted in Fig. 1.23b. 


1.5-1 Some Properties of Even and Odd Functions 
Even and odd functions have the following property: 


even function x odd function = odd function 
odd function x odd function = even function 
even function x even function = even function 


The proofs of these facts are trivial and follow directly from the definition of odd 
and even functions [Eqs. (1.31) and (1.32)]. 


Area 


Because fe(t) is symmetrical about the vertical axis, it follows from Fig. 1.23a 
that 


: felt) dt = a fe(t) dt (1.33a) 


It is also clear from Fig. 1.23b that 
a 
fo(t) dt = 0 (1.33b) 
—a 


These results can also be proved formally by using the definitions in Eqs. (1.31) and 
(1.32). We leave them as an exercise for the reader. 
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Fig. 1.24 Finding an even and odd components of a signal. 


1.5-2 Even and Odd Components of a Signal 


Every signal f(t) can be expressed as a sum of even and odd components 
because 


F(t) = a [f@) + F(t] + E- £(-2)] (1.34) 
enema a S a 
even odd 


From the definitions in Eqs. (1.31) and (1.32), we can clearly see that the first 
component on the right-hand side is an even function, while the second component 
is odd. This is apparent from the fact that replacing t by —t in the first component 
yields the same function. The same maneuver in the second component yields the 
negative of that component. 


Consider the function 
f(t) = e7*u(t) 


Expressing this function as a sum of the even and odd components f,(t) and folt), 
we obtain 


F(t) = felt) + folt) 
where [from Eq. (1.34)] 


felt) = $ [e~*u(t) + e“*u(—t)] (1.35a) 
and 


fo(t) = 4 [e~**u(t) - e%u(—t)] (1.35b) 
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The function e~**u(t) and its even and odd components are illustrated in Fig. 1.24. 


E Example 1.8 . B 
Find the even and odd components of e”. 
From Eq. (1.34) 
e” = felt) + folt) 
where 
fe(t)=4 [e7 +e] = cos t 
and 


folt) = 4 [e** - et} =jsint W 


1.6 Systems 


As mentioned in Sec. 1.1, systems are used to process signals in order to modify 
or to extract additional information from the signals. A system may consist of 
physical components (hardware realization) or may consist of an algorithm that 
computes the output signal from the input signal (software realization). 

A system is characterized by its inputs, its outputs (or responses), and the 
rules of operation (or laws) adequate to describe its behavior. For example, in 
electrical systems, the laws of operation are the familiar voltage-current relation- 
ships for the resistors, capacitors, inductors, transformers, transistors, and so on, 
as well as the laws of interconnection (i.e., Kirchhoff’s laws). Using these laws, 
we derive mathematical equations relating the outputs to the inputs. These equa- 
tions then represent a mathematical model of the system. Thus a system is 
characterized by its inputs, its outputs, and its mathematical model. 

A system can be conveniently illustrated by a “black box” with one set of 
accessible terminals where the input variables fi(t), f(t), .. + fj (t) are applied and 
another set of accessible terminals where the output variables y1(t), ya(t), -n y(t) 
are observed. Note that the direction of the arrows for the variables in Fig. 1.25 is 
always from cause to effect. 


Fig. 1.25 Representation of a system. 


The study of systems consists of three major areas: mathematical modeling, 
analysis, and design. Although we shall be dealing with mathematical modeling, our 
main concern is with analysis and design. The major portion of this book is devoted 
to the analysis problem—how to determine the system outputs for the given inputs 
and a given mathematical model of the system (or rules governing the system). To 
a lesser extent, we will also consider the problem of design or synthesis—how to 
construct a system which will produce a desired set of outputs for the given inputs. 
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Fig. 1.26 An example of a simple electrical system. 


Data Needed to Compute System Response 


In order to understand what data we need to compute a system response, 
consider a simple RC circuit with a current source f(t) as its input (Fig. 1.26). The 
output voltage y(t) is given by 


y(t) = Rf(t)+ 5 f f(r) dr (1.36a) 


The limits of the integral on the right-hand side are from —oo to t because this 
integral represents the capacitor charge due to the current f(t) flowing in the ca- 
pacitor, and this charge is the result of the current flowing in the capacitor from 
—oo. Now, Eq. (1.36a) can be expressed as 


0 t 
y= Ri + of TOLES- f(r) dr (1.36b) 


The middle term on the right-hand side is vc(0), the capacitor voltage at t = 0. 
Therefore 


1 ft 
y(t) = vc (0) + RF(t) + af f(r)dr (1.36c) 
0 
This equation can be readily generalized as 
1 
u(t) = volte) + RFQ) + = J f(r)dr (1.364) 
to 


From Eq. (1.36a), the output voltage y(t) at an instant t can be computed if we 
know the input current flowing in the capacitor throughout its entire past (—oo to 
t). Alternatively, if we know the input current f(t) from some moment tp onward, 
then, using Eq. (1.36d), we can still calculate y(t) for t 2 to from a knowledge of 
the input current, provided we know vc(to), the initial capacitor voltage (voltage 
at to). Thus v¢(to) contains all the relevant information about the circuit’s entire 
past (—0o to to) that we need to compute y(t) for t 2 to. Therefore, the response 
of a system at t > tg can be determined from its input(s) during the interval to to 
t and from certain initial conditions at t = to. 

In the preceding example, we needed only one initial condition. However, in 
more complex systems, several initial conditions may be necessary. We know, for 
example, that in passive RLC networks, the initial values of all inductor currents 
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and all capacitor voltages} are needed to determine the outputs at any instant t > 0 
if the inputs are given over the interval (0, t]. 


1.7 Classification of Systems 


Systems may be classified broadly in the following categories:{ 
. Linear and nonlinear systems; 
. Constant-parameter and time-varying-parameter systems; 
. Instantaneous (memoryless) and dynamic (with memory) systems; 
. Causal and noncausal systems; 
Lumped-parameter and distributed-parameter systems; 
. Continuous-time and discrete-time systems; 


NOT wne 


. Analog and Digital systems; 


1.7-1 Linear and Nonlinear Systems 


The Concept of Linearity 

A system whose output is proportional to its input is an example of a linear 
system. But linearity implies more than this; it also implies additivity property, 
implying that if several causes are acting on a system, then the total effect on 
the system due to all these causes can be determined by considering each cause 
separately while assuming all the other causes to be zero. The total effect is then 
the sum of all the component effects. This property may be expressed as follows: 
for a linear system, if a cause cı acting alone has an effect e1, and if another cause 
c2, also acting alone, has an effect e2, then, with both causes acting on the system, 
the total effect will be e; + e2. Thus, if 


ca — e and cg — €2 (1.37) 
then for all cı and c2 
cy t cg — e1 +2 (1.38) 


In addition, a linear system must satisfy the homogeneity or scaling property, 
which states that for arbitrary real or imaginary number k, if a cause is increased 
k-fold, the effect also increases k-fold. Thus, if 
e—e 
then for all real or imaginary k 
ke — ke (1.39) 


Thus, linearity implies two properties: homogeneity (scaling) and additivity$. Both 
these properties can be combined into one property (superposition), which is 
expressed as follows: If 


cy — e and cg — €2 


then for all values of constants kı and k2, 


f Strictly speaking, independent inductor currents and capacitor voltages. 

} Other classifications, such as deterministic and probabilistic systems, are beyond the scope of 
this text and are not considered. 

$ A linear system must also satisfy the additional condition of smoothness, where small changes 
in the system’s inputs must result in small changes in its outputs.” 
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kıcı + kecq —> kye1 + kee (1.40) 


This is true for all cı and cg. 

It may appear that additivity implies homogeneity. Unfortunately, there are 
cases where homogeneity does not follow from additivity. See the case in Exercise 
E1.11 below. 


A Exercise E1.11 

Show that a system with the input (cause) c(t) and the output (effect) e(t) related by e(t) = 
Re{c(t)} satisfies the additivity property but violates the homogeneity property. Hence, such a 
system is not linear. 


Hint: show that Eq. (1.39) is not satisfied when k is complex. VY 
Response of a Linear System 


For the sake of simplicity, we discuss below only single-input, single-output 
(SISO) systems. But the discussion can be readily extended to multiple-input, 
multiple-output (MIMO) systems. 

A system’s output for t > 0 is the result of two independent causes: the initial 
conditions of the system (or the system state) at t = 0 and the input f(t) for t > 0. 
If a system is to be linear, the output must be the sum of the two components 
resulting from these two causes: first, the zero-input response component that 
results only from the initial conditions at t = 0 with the input f(t) = 0 for t 2 0, 
and then the zero-state response component that results only from the input f (t) 
for t > 0 when the initial conditions (at t = 0) are assumed to be zero. When all 
the appropriate initial conditions are zero, the system is said to be in zero state. 
The system output is zero when the input is zero only if the system is in zero state. 

In summary, a linear system response can be expressed as the sum of a zero- 
input and a zero-state component: 


Total response = zero-input response + zero-state response (1.41) 


This property of linear systems which permits the separation of an output into 
components resulting from the initial conditions and from the input is called the 
decomposition property. 

For the RC circuit of Fig. 1.26, the response y(t) was found to be [see Eq. 
(1.36¢)] 


t 
y= vol) RIH | Far (1.42) 
“= C Jo 
z—i component ~me 
z—8 component 
From Eq. (1.42), it is clear that if the input f(t) = 0 for t > 0, the output y(t) = 
vo(0). Hence vo(0) is the zero-input component of the response y(t). Similarly, if 
the system state (the voltage vc in this case) is zero at t = 0, the output is given 
by the second component on the right-hand side of Eq. (1.42). Clearly this is the 
zero-state component of the response y(t). 

In addition to the decomposition property, linearity implies that both the zero- 
input and zero-state components must obey the principle of superposition with 
respect to each of their respective causes. For example, if we increase the initial 
condition k-fold, the zero-input component must also increase k-fold. Similarly, if 
we increase the input k-fold, the zero-state component must also increase k-fold. 
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These facts can be readily verified from Eq. (1.42) for the RC circuit in Fig. 1.26. 
For instance, if we double the initial condition vc(0), the zero-input component 
doubles; if we double the input f(t), the zero-state component doubles. 3 
E Example 1.9 
Show that the system described by the equation 
dy 


Y i ay(t) = F(t (1.43) 


is linear. 
Let the system response to the inputs fi(t) and f2(t) be yi(t) and y2(t), respectively. 
Then 


d 

TE tanle) = Alt) 
and 

“2 t aya(t) = falt) 


Multiplying the first equation by kı, the second with k2, and adding them yields 


d 
a Kl) + kaye(t)) +3 [kiyi (t) + kzy2(t)] = kifi(t) + k2f2(t) 
But this equation is the system equation [Eq. (1.43)] with 


f(t) = ki fi(t) + k2f2(t) 


and 
y(t) = kıyı (t) + k2y2(t) 


Therefore, when the input is kif1(t) + kzf2(t), the system response is kiy1(t) + k2y2(t). 
Consequently, the system is linear. Using this argument, we can readily generalize the 
result to show that a system described by a differential equation of the form 

dy d'y a” f df 

SE E E = by —— aes — 1.44 

Tn + an lei ++->+aoy = bm am + tha + bof ( ) 
is a linear system. The coefficients a; and b; in this equation can be constants or functions 
of time. W 


A Exercise E1.12 
Show that the system described by the following equation is linear: 


d 
Z tey = (A3 V 
A Exercise £1.13 


Show that a system described by the following equation is nonlinear: 
d 
AF A= Vv 


More Comments on Linear Systems 


Almost all systems observed in practice become nonlinear when large enough 
signals are applied to them. However, many systems show linear behavior for small 
signals. The analysis of nonlinear systems is generally difficult. Nonlinearities can 
arise in so many ways that describing them with a common mathematical form 
is impossible. Not only is each system a category in itself, but even for a given 
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system, changes in initial conditions or input amplitudes may change the nature of 
the problem. On the other hand, the superposition property of linear systems is a 
powerful unifying principle which allows for a general solution. The superposition 
property (linearity) greatly simplifies the analysis of linear systems. Because of 
the decomposition property, we can evaluate separately the two components of the 
output. The zero-input component can be computed by assuming the input to 
be zero, and the zero-state component can be computed by assuming zero initial 
conditions. Moreover, if we express an input f(t) as a sum of simpler functions, 


f(t) = aifi(t) + aafe(t) + +++ + @mfm(t) 


then, by virtue of linearity, the response y(t) is given by 


y(t) = ayyi(t) + azy2(t) +--+ + amym(t) (1.45) 


where y;(t) is the zero-state response to an input f(t). This apparently trivial 
observation has profound implications. As we shall see repeatedly in later chapters, 
it proves extremely useful and opens new avenues for analyzing linear systems. 


f(t) F(t) 


Fig. 1.27 Signal representation in terms of impulse and step components. 


As an example, consider an arbitrary input f(t) such as the one shown in 
Fig. 1.27a. We can approximate f(t) with a sum of rectangular pulses of width 
At and of varying heights. The approximation improves as At — 0, when the 
rectangular pulses become impulses spaced At seconds apart (with At > 0). Thus, 
an arbitrary input can be replaced by a weighted sum of impulses spaced At (At — 
0) seconds apart. Therefore, if we know the system response to a unit impulse, 
we can immediately determine the system response to an arbitrary input f(t) by 
adding the system response to each impulse component of f(t). A similar situation 
is depicted in Fig. 1.27b, where f(t) is approximated by a sum of step functions of 
varying magnitude and spaced At seconds apart. The approximation improves as 
At becomes smaller. Therefore, if we know the system response to a unit step input, 
we can compute the system response to any arbitrary input f(t) with relative ease. 
Time-domain analysis of linear systems (discussed in Chapter 2) uses this approach. 

In Chapters 4,6,10, and 11 we employ the same approach but instead use 
sinusoids or exponentials as our basic signal components. There, we show that 
any arbitrary input signal can be expressed as a weighted sum of sinusoids (or 
exponentials) having various frequencies. Thus a knowledge of the system response 
to a sinusoid enables us to determine the system response to an arbitrary input 


f(t). 
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Fig. 1.28 Time-invariance property. 


1.7-2 Time-Invariant and Time-Varying Parameter Systems 


Systems whose parameters do not change with time are time-invariant (also 
constant-parameter) systems. For such a system, if the input is delayed by T 
seconds, the output is the same as before but delayed by T (assuming identical 
initial conditions). This property is expressed graphically in Fig. 1.28. 

It is possible to verify that the system in Fig. 1.26 is a time-invariant system. 
Networks composed of RLC elements and other commonly used active elements 
such as transistors are time-invariant systems. A system with an input-output 
relationship described by a linear differential equation of the form (1.44) is a linear 
time-invariant (LTI) system when the coefficients a; and b; of such equation are 
constants. If these coefficients are functions of time, then the system is a linear 
time-varying system. The system described in exercise E1.12 is an example of a 
linear time-varying system. Another familiar example of a time-varying system is 
the carbon microphone, in which the resistance R is a function of the mechanical 
pressure generated by sound waves on the carbon granules of the microphone. An 
equivalent circuit for the microphone appears in Fig. 1.29. The response is the 
current i(t), and the equation describing the circuit is 


di(t) 


L 
dt 


+ Ril) = F(t) 


One of the coefficients in this equation, R(t), is time-varying. 


A Exercise E1.14 
Show that a system described by the following equation is time-varying parameter system: 


y(t) = (sin t) f(t — 2) 
Hint: Show that the system fails to satisfy the time-invariance property. Y 
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HOL R(t) 


Fig. 1.29 An example of a linear time-varying system. 


1.7-3 Instantaneous and Dynamic Systems 


As observed earlier, a system’s output at any instant t generally depends upon 
the entire past input. However, in a special class of systems, the output at any 
instant t depends only on its input at that instant. In resistive networks, for exam- 
ple, any output of the network at some instant t depends only on the input at the 
instant t. In these systems, past history is irrelevant in determining the response. 
Such systems are said to be instantaneous or memoryless systems. More pre- 
cisely, a system is said to be instantaneous (or memoryless) if its output at any 
instant t depends, at most, on the strength of its input(s) at the same instant but 
not on any past or future values of the input(s). Otherwise, the system is said to be 
dynamic (or a system with memory). A system whose response at t is completely 
determined by the input signals over the past T seconds {interval from (t — T) to 
t] is a finite-memory system with a memory of T seconds. Networks contain- 
ing inductive and capacitive elements generally have infinite memory because the 
response of such networks at any instant t is determined by their inputs over the 
entire past (—0o,t). This is true for the RC circuit of Fig. 1.26. 

In this book we will generally examine dynamic systems. Instantaneous systems 
are a special case of dynamic systems. 


1.7-4 Causal and Noncausal Systems 


A causal (also known as a physical or non-anticipative) system is one for 
which the output at any instant to depends only on the value of the input f(t) for 
t < to. In other words, the value of the output at the present instant depends only 
on the past and present values of the input f(t), not on its future values. To put 
it simply, in a causal system the output cannot start before the input is applied. If 
the response starts before the input, it means that the system knows the input in 
the future and acts on this knowledge before the input is applied. A system that 
violates the condition of causality is called a noncausal (or anticipative) system. 

Any practical system that operates in real timet must necessarily be causal. 
We do not yet know how to build a system that can respond to future inputs (inputs 
not yet applied). A noncausal system is a prophetic system that knows the future 
input and acts on it in the present. Thus, if we apply an input starting at t = 0 
to a noncausal system, the output would begin even before t = 0. As an example, 
consider the system specified by 


y(t) = f(t- 2) + f(t + 2) (1.46) 


Pn 


{In real-time operations, the response to an input is essentially simultaneous (contempo- 
raneous) with the input itself. 
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Fig. 1.30 A noncausal system and its realization by a delayed causal system. 


For the input f (t) illustrated in Fig. 1.30a, the output y(¢), as computed from 
Eq. (1.46) (shown in Fig. 1.30b), starts even before the input is applied. Equation 
(1.46) shows that y(t), the output at t, is given by the sum of the input values two 
seconds before and two seconds after t (att-2andt+2 respectively). But if we 
are operating the system in real time at t, we do not know what the value of the 
input will be two seconds later. Thus it is impossible to implement this system in 
real time. For this reason, noncausal systems are unrealizable in real time. 


Why Study Noncausal Systems? 

From the above discussion it may seem that noncausal systems have no practical 
purpose. This is not the case; they are valuable in the study of systems for several 
reasons. First, noncausal systems are realizable when the independent variable is 
other than “time” (e.g., space). Consider, for example, an electric charge of density 
q(x) placed along the z-axis for z > 0. This charge density produces an electric field 
E(x) that is present at every point on the z-axis from s = —00 to oo. In this case the 
input [i.e., the charge density q(x)| starts at z = 0, but its output [the electric field 
E(a)| begins before s = 0. Clearly, this space charge system is noncausal. This 
discussion shows that only temporal systems (systems with time as independent 
variable) must be causal in order to be realizable. The terms “before” and “after” 
have a special connection to causality only when the independent variable is time. 
This connection is lost for variables other than time. Nontemporal systems, such 
as those occurring in optics, can be noncausal and still realizable. 

Moreover, even for temporal systems, such as those used for signal processing, 
the study of noncausal systems is important. In such systems we may have all input 
data prerecorded. (This often happens with speech, geophysical, and meteorological 
signals, and with space probes.) In such cases, the input’s future values are available 
to us. For example, suppose we had a set of input signal records available for the 
system described by Eq. (1.46). We can then compute y(t) since, for any t, we need 
only refer to the records to find the input’s value two seconds before and two seconds 
after t. Thus, noncausal systems can be realized, although not in real time. We 


86 1 Introduction to Signals and Systems 


OH GREAT WIZARD || I NEED SonE HOW MUCH 
TELL ME WHAT THE} TIME To TIME DO You 


R STOCKS WiLL BE DIVINE, NEED? 
DOING A YEAR ‘ Y 
FRoH NOW. 


Noncausal systems are realizable with time delay! 


may therefore be able to realize a noncausal system, provided that we are willing 
to accept a time delay in the output. Consider a system whose output g(t) is the 
same as y(t) in Eq. (1.46) delayed by two seconds (Fig 1.30c), so that 


g(t) = y(t — 2) 
= f(t-4) +f) 


Here the value of the output ĝ at any instant t is the sum of the values of the input 
f at t and at the instant four seconds earlier {at (t — 4)]. In this case, the output 
at any instant £ does not depend on future values of the input, and the system is 
causal. The output of this system, which is (t), is identical to that in Eq. (1.46) 
or Fig. 1.30b except for a delay of two seconds. Thus, a noncausal system may be 
realized or satisfactorily approximated in real time by using a causal system with a 
delay. 

A third reason for studying noncausal systems is that they provide an upper 
bound on the performance of causal systems. For example, if we wish to design 
a filter for separating a signal from noise, then the optimum filter is invariably a 
noncausal system. Although unrealizable, this noncausal system’s performance acts 
as the upper limit on what can be achieved and gives us a standard for evaluating 
the performance of causal filters. 

At first glance, noncausal systems may seem inscrutable. Actually, there is 
nothing mysterious about these systems and their approximate realization through 
using physical systems with delay. If we want to know what will happen one year 
from now, we have two choices: go to a prophet (an unrealizable person) who can 
give the answers immediately, or go to a wise man and allow him a delay of one 
year to give us the answer! If the wise man is truly wise, he may even be able to 
shrewdly guess the future very closely with a delay of less than a year by studying 
trends. Such is the case with noncausal systems—nothing more and nothing less. 


A Exercise E1.15 
Show that a system described by the equation below is noncausal: 


t+5 
y(t) = | F(T) dr 
t 


-5 
Show that this system can be realized physically if we accept a delay of 5 seconds in the output. 
v 
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1.7-5 Lumped-Parameter and Distributed-Parameter Systems 


In the study of electrical systems, we make use of voltage-current relationships 
for various components (Ohm’s law, for example). In doing so, we implicitly assume“ 
that the current in any system component (resistor, inductor, etc.) is the same at 
every point throughout that component. Thus, we assume that electrical signals are 
propagated instantaneously throughout the system. In reality, however, electrical 
signals are electromagnetic space waves requiring some finite propagation time. 
An electric current, for example, propagates through a component with a finite 
velocity and therefore may exhibit different values at different locations in the same 
component. Thus, an electric current is a function not only of time but also of 
space. However, if the physical dimensions of a component are small compared to 
the wavelength of the signal propagated, we may assume that the current is constant 
throughout the component. This is the assumption made in lumped-parameter 
systems, where each component is regarded as being lumped at one point in space. 
Such an assumption is justified at lower frequencies (higher wavelength). Therefore, 
in lumped-parameter models, signals can be assumed to be functions of time alone. 
For such systems, the system equations require only one independent variable (time) 
and therefore are ordinary differential equations. 

In contrast, for distributed-parameter systems such as transmission lines, 
waveguides, antennas, and microwave tubes, the system dimensions cannot be as- 
sumed to be small compared to the wavelengths of the signals; thus the lumped- 
parameter assumption breaks down. The signals here are functions of space as 
well as of time, leading to mathematical models consisting of partial differential 
equations.’ The discussion in this book will be restricted to lumped-parameter sys- 
tems only. 


1.7-6 Continuous-Time and Discrete-Time Systems 


Distinction between discrete-time and continuous-time signals is discussed in 
Sec. 1.2-1. Systems whose inputs and outputs are continuous-time signals are 
continuous-time systems. On the other hand, systems whose inputs and out- 
puts are discrete-time signals are discrete-time systems. If a continuous-time 
signal is sampled, the resulting signal is a discrete-time signal. We can process a 
continuous-time signal by processing its samples with a discrete-time system. 


1.7-7 Analog and Digital Systems 


Analog and digital signals are discussed in Sec. 1.2-2. A system whose input 
and output signals are analog is an analog system; a system whose input and 
output signals are digital is a digital system. A digital computer is an example 
of a digital (binary) system. Observe that a digital computer is an example of a 
system that is digital as well as discrete-time. 


Additional Classification of Systems 
There are additional classes of systems, such as invertible and noninvertible 


systems. A system S performs certain operation(s) on input signal(s). If we can 
obtain the input f(t) back from the output y(t) by some operation, the system 
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S is said to be invertible. For a noninvertible system, different inputs can result 
in the same output (as in a rectifier), and it is impossible to determine the input 
for a given output. Therefore, for an invertible system, it is essential that distinct 
inputs result in distinct outputs so that there is one-to-one mapping between an 
input and the corresponding output. This ensures that every output has a unique 
input. Consequently, the system is invertible. The system that achieves this inverse 
operation [of obtaining f(t) from y(t)] is the inverse system of S. For instance, 
A system whose input and output are related by equation y(t) = a f(t) + 6 is 
an invertible system. But a rectifier, specified by the equation y(t) = |f (eI is 
noninvertible because the rectification operation cannot be undone. 

An ideal differentiator is noninvertible because integration of its output cannot 
restore the original signal unless we know one piece of information about the signal. 
For instance, if f (t) = 3t +5, the output of the differentiator is y(t) = 3. If this 
output is applied to an integrator, the output is 3t + c, where c is an arbitrary 
constant. If we know one piece of information about f(t), such as f(0) = 5, we can 
determine the input to be f(t) = 3t+5. Thus, a differentiator along with one piece 
of information (known as auxiliary condition) is an invertible system.{ Similarly, 
a system consisting of a cascade of two differentiators is invertible, if we know two 
independent pieces of information (auxiliary conditions) about the input signal. 

In addition, systems can also be classified as stable or unstable systems. The 
concept of stability is discussed in more depth in later chapters. 


A Exercise E1.16 
Show that a system described by the equation y(t) = f?(t) is noninvertible. y 


1.8 System Model: Input-output Description 


As mentioned earlier, systems theory encompasses a variety of systems, such 
as electrical, mechanical, hydraulic, acoustic, electromechanical, and chemical, as 
well as social, political, economic, and biological. The first step in analyzing any 
system is the construction of a system model, which is a mathematical expression 
or a rule that satisfactorily approximates the dynamical behavior of the system. 
In this chapter we shall consider only the continuous-time systems. (Modeling of 
discrete-time systems is discussed in Chapter 8.) 

To construct a system model, we must study the relationships between differ- 
ent variables in the system. In electrical systems, for example, we must determine 
a satisfactory model for the voltage-current relationship of each element, such as 
Ohm’s law for a resistor. In addition, we must determine the various constraints on 
voltages and currents when several electrical elements are interconnected. These are 
the laws of interconnection—the well-known Kirchhoff’s voltage and current laws 
(KVL and KCL). From all these equations, we eliminate unwanted variables to 
obtain equation(s) relating the desired output variable(s) to the input(s). The fol- 
lowing examples demonstrate the procedure of deriving input-output relationships 
for some LTI electrical systems. 


{The additional piece of information cannot be just any information. For instance, in the above 
example, if we are given f(0) = 0, it will not help in determining c, and the system is noninvertible. 


1.8 System Model: Input-Output Description 89 


f(t) 


Fig. 1.31 Circuit for Example 1.10. 


E Example 1.10 ; 
For the series RLC circuit of Fig. 1.31, find the input-output equation relating the 


input voltage f(t) to the output current (loop current) y(t). 
Application of the Kirchhoff’s voltage law around the loop yields 


vr(t) + va(t) + volt) = f(t) (1.47) 


By using the voltage-current laws of each element (inductor, resistor, and capacitor), we 
can express this equation as 


dy 
et 2 
qr t Sut) + / 


t 


y(r) dr = f(t) (1.48) 


Differentiating both sides of this equation obtains 


ry + a% + 2y(t) = ¢ (1.49) 
This differential equation is the input-output relationship between the output y(t) 
and the input f(t). W 
It proves convenient to use a compact notation D for the differential operator 
4. Thus 


dy 


d? 
D = D*y(t) (1.51) 


and so on. With this notation, Eq. (1.49) can be expressed as 


(D? + 3D +2) y(t) = Df(t) (1.52) 


The differential operator is the inverse of the integral operator, so we can use 
the operator 1/D to represent integrationt. 


1 1.53 
f_n (1.53) 


0 


t Use of operator 1/D for integration generates some subtle mathematical difficulties because 
the operators D and 1/D do not commute. For instance, we know that D(1/D) = 1 because 


4j es y(t) dr] = y(t). However, $D is not necessarily unity. Use of Cramer’s rule in solving 


simultaneous integro-differential equations will always result in cancellation of operators 1/ D and 
D. This procedure may yield erroneous results in those cases where the factor D occurs in the 
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R=15Q 


f(t) 


Fig. 1.32 Circuit for Example 1.11. 


Consequently, the loop equation (1.48) can be expressed as 


2 
(0 +3+ ) y(t) = f(t) (1.54) 
Multiplying both sides by D, that is, differentiating Eq. (1.54), we obtain 


(D? + 3D +2) y(t) = Df(t) (1.55) 


which is identical to Eq. (1.52). 

Recall that Eq. (1.55) is not an algebraic equation, and D? + 3D + 2 is not an 
algebraic term that multiplies y(t); it is an operator that operates on y(t). It means 
that we must perform the following operations on y(t): take the second derivative 
of y(t) and add to it 3 times the first derivative of y(t) and 2 times y(t). Clearly, 
a polynomial in D multiplied by y(t) represents a certain differential operation on 


y(t). 


@ Example 1.11 

Find the equation relating the input to output for the series RC circuit of Fig. 1.32 
if the input is the voltage f(t) and output is (a) the loop current z(t) (b) the capacitor 
voltage y(t). 

The loop equation for the circuit is 


Re(t) +3 f a(r) dr = f(t) (1.56) 
or 
152(t) + sf u(r) dr = f(t) (1.57) 


With operational notation, this equation can be expressed as 


numerator as well as in the denominator. This happens, for instance, in circuits with all-inductor 
loops or all-capacitor cutsets. To eliminate this problem, avoid the integral operation in system 
equations so that the resulting equations are differential rather than integro-differential. In elec- 
trical circuits, this can be done by using charge (instead of current) variables in loops containing 
capacitors and using current variables for loops without capacitors. In the literature this problem 
of commutativity of D and 1/D is largely ignored. As mentioned earlier, such procedure gives er- 
roneous results only in special systems, such as the circuits with all-inductor loops or all-capacitor 
cutsets. Fortunately such systems constitute a very small fraction of the systems we deal with. 
For further discussion of this topic and a correct method of handling problems involving integrals, 
see Ref. 4 
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152(t) + a(t) = flè) (1.58) 


Multiplying both sides of the above equation by D (that is, differentiating the above 
equation), we obtain 


(15D + 5)x(t) = Df (t) (1.59a) 
or Pr 
z 
Moreover, 
d 
st) =c% 
= i Dyle) 


Substitution of this result in Eq. (1.59a) yields 


(3D + 1)y(t) = f(t) (1.60) 

or d 
3T tut) = O (1.61) 
B 


A Exercise E1.17 i PIN l 
For the RLC circuit in Fig. 1.31, find the input-output relationship if the output is the 
inductor voltage vz (t). 


Hint: vz (t) = LDy(t) = Dy(t). Answer: (D? +3D +2) oz(t) = D?) V 


A Exercise E1.18 i a i 
For the RLC circuit in Fig. 1.31, find the input-output relationship if the output is the 
capacitor voltage vc (t). 


Hint: vo(t) = gpy(t) = ult). Answer: (D? +3D + 2) vo(t) = 2f) V 


iy f(t) 
6 (t) 
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Fig. 1.33 Armature controlled de motor. 


@ Example 1.12 

In rotational systems, the equations of motion are similar to those in translational 
systems. In place of force F, we have torque T. In place of mass M, we have moment 
of inertia J (the rotational mass), and in place of linear acceleration ¢, we have angular 
acceleration 6. The equation of motion for rotational systems is T = J@ (in place of 
F = Mi). 

A wide variety of electromechanical systems convert electrical signals into mechanical 
motion (mechanical energy) and vice versa. Here we consider a rather simple example of 
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an armature-controlled dc motor (with a constant field current i) driven by a current 
source f(t), as depicted in Fig. 1.33a. Let 0(t) be the angular position of the rotor. The 
torque T(t) generated in the rotor is proportional to the armature current f(t). Therefore 


T(t) = Krf(t) (1.62) 
where Kr is a constant of the motor. This torque drives a mechanical load whose free- 
body diagram is illustrated in Fig. 1.33b. The viscous damping (with coefficient B), which 
is proportional to the angular velocity 6, dissipates a torque BO(t). If J is the moment of 


inertia of the load (including the rotor of the motor), then the net torque T(t) - BG(t) 
available must equal to J6(t); 


aoe JÖ) = T(t) - Ba(t) (1.63) 


(JD? + BD) 6(t) = T(t) 


= Krf(t) (1.64) 
which can be expressed as 
D(D + a)0(t) = Kı f(t) (1.65) 
where a = B/J and Ki = Kr/J. 
E 


1.8-1 Internal and External Descriptions of a System 


With a knowledge of the internal structure of a system, we can write system 
equations yielding an internal description of the system. In contrast, the sys- 
tem description seen from the system’s input and output terminals is the system’s 
external description. To understand an external description, suppose that a sys- 
tem is enclosed in a “black box” with only its input(s) and output(s) terminals 
accessible. In order to describe or characterize such a system, we must perform 
some measurements at these terminals. For example, we might apply a known in- 
put, such as a unit impulse or a unit step, and then measure the system’s output. 
The description provided by such a measurement is an external description of the 
system. 

Suppose the circuit in Fig. 1.34a with the input f(t) and the output y(t) is 
enclosed inside a “black box” with only the input and output terminals accessible. 
Under these conditions the only way to describe or specify the system is with exter- 
nal measurements. We can, for example, apply a known voltage f(t) at the input 
terminals and measure the resulting output voltage y(t). From this information we 
can describe or characterize the system. This is the external description. 

Assuming zero initial capacitor voltage, the input voltage f (t) produces a cur- 
rent i (Fig. 1.34a), which divides equally between the two branches because of the 
balanced nature of the circuit. Thus, the voltage across the capacitor continues to 
remain zero. Therefore, for the purpose of computing the current i, the capacitor 
may be removed or replaced by a short. The resulting circuit is equivalent to that 
shown in Fig. 1.34b. It is clear from Fig. 1.34b that f(t) sees a net resistance of 
59, and 


i) = 3h) 
Also, because y(t) = 2 x (i/2) =i, 


y(t) = = F(t) (1.66) 


5 
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Fig. 1.34 A system that cannot be described by external measurements. 


The equivalent system as seen from the system’s external terminals is depicted in 
Fig. 1.34b. Clearly, for the external description, the capacitor does not exist. For 
most systems, the external and internal descriptions are identical, but there are a 
few exceptions, as in the present case, where the external description gives an inad- 
equate picture of the systems. This happens when the system is uncontrollable 
and/or unobservable. Figures 1.35a and 1.35b show a structural representation 
of simple uncontrollable and unobservable systems respectively. In Fig. 1.35a we 
note that part of the system (subsystem S2) inside the box cannot be controlled by 
the input f(t). In Fig. 1.35b some of the system outputs (those in subsystem S2) 
cannot be observed from the output terminals. If we try to describe either of these 
systems by applying an external input f(t) and then measuring the output y(t), 
the measurement will not characterize the complete system but only the part of the 
system (here $1) that is both controllable and observable (linked to both the input 
and output). Such systems are undesirable in practice and should be avoided in any 
system design. The system in Fig. 1.35a can be shown to be neither controllable 
nor observable. It can be represented structurally as a combination of the systems 
in Figs. 1.35a and 1.35b. 


(a) (b) 


Fig. 1.35 Structures of uncontrollable and unobservable systems. 
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1.9 Summary 


A signal is a set of information or data. A system processes input signals 
to modify them or extract additional information from them to produce output 
signals (response). A system may be made up of physical components (hardware 
realization) or may be an algorithm that computes an output signal from an input 
signal (software realization). 

A convenient measure of the size of a signal is its energy if it is finite. If the 
signal energy is infinite, the appropriate measure is its power, if it exists. The signal 
power is the time average of its energy (averaged over the entire time interval from 
—co to oo). For periodic signals the time averaging need be performed only over 
one period in view of the periodic repetition of the signal. Signal power is also equal 
to the mean squared value of the signal (averaged over the entire time interval from 
t = —00 to 00). 


Signals can be classified in several ways as follows: 


1. A continuous-time signal is specified for a continuum of values of the indepen- 
dent variable (such as time t). A discrete-time signal is specified only at a finite 
or a countable set of time instants. 

2. An analog signal is a signal whose amplitude can take on any value over a con- 
tinuum. On the other hand, a signal whose amplitudes can take on only a finite 
number of values is a digital signal. The terms discrete-time and continuous- 
time qualify the nature of a signal along the time axis (horizontal axis). The 
terms analog and digital, on the other hand, qualify the nature of the signal 
amplitude (vertical axis). 

3. A periodic signal f(t) is defined by the fact that f(t) = f(t + To) for some 
To. The smallest value of To for which this relationship is satisfied is called the 
period. A periodic signal remains unchanged when shifted by an integral mul- 
tiple of its period. A periodic signal can be generated by a periodic extension 
of any segment of f(t) of duration To. Finally, a periodic signal, by definition, 
must exist over the entire time interval -co < t < oo. A signal is aperiodic if 
it is not periodic. 

An everlasting signal starts at t = —oo and continues forever to t = œ. A 
causal signal is a signal that is zero for t < 0. Hence, periodic signals are 
everlasting signals. 

4. A signal with finite energy is an energy signal. Similarly a signal with a finite 
and nonzero power (mean square value) is a power signal. A signal can either 
be an energy signal or a power signal, but not both. However, there are signals 
that are neither energy nor power signals. 

5. A signal whose physical description is known completely in a mathematical or 
graphical form is a deterministic signal. A random signal is known only in 
terms of its probabilistic description such as mean value, mean square value, 
and so on, rather than its mathematical or graphical form. 

A signal f(t) delayed by T seconds (right-shifted) is given by f(t ~ T); on the 
other hand, f(t) advanced by T (left-shifted) is given by f(t +T). A signal f(t) 
time-compressed by a factor a (a > 1) is given by f (at); on the other hand, the same 
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signal time-expanded by factor a is given by f(£). The same signal time-inverted 
is given by f(—t). 


The unit step function u(t) is very useful in representing causal signals and 
signals with different mathematical descriptions over different intervals. 


In the classical definition, the unit impulse function 6(t) is characterized by 
unit area, and the fact that it is concentrated at a single instant t = 0. The impulse 
function has a sampling (or sifting) property, which states that the area under the 
product of a function with a unit impulse is equal to the value of that function at 
the instant where the impulse is located (assuming the function to be continuous 
at the impulse location). In the modern approach, the impulse function is viewed 
as a generalized function and is defined by the sampling property. 


The exponential function e**, where s is complex, encompasses a large class 
of signals that includes a constant, a monotonic exponential, a sinusoid, and an 
exponentially varying sinusoid. 


A signal that is symmetrical about the vertical axis (t = 0) is an even function 
of time, and a signal that is antisymmetrical about the vertical axis is an odd 
function of time. The product of an even function with an odd function results in 
an odd function. However, the product of an even function with an even function or 
an odd function with an odd function results in an even function. The area under 


an odd function from t = —a to a is always zero regardless of the value of a. On 
the other hand, the area under an even function from t = —a to a is two times the 
area under the same function from t = 0 to a (or from t = —a to 0). Every signal 


can be expressed as a sum of odd and even function of time. 


A system processes input signals to produce output signals (response). The 
input is the cause and the output is its effect. In general, the output is affected 
by two causes: the internal conditions of the system (such as the initial conditions) 
and the external input. 

Systems can be classified in several ways: 


1. Linear systems are characterized by the linearity property, which implies su- 
perposition; if several causes (such as various inputs and initial conditions) are 
acting on a linear system, the total effect (response) is the sum of the responses 
from each cause, assuming that all the remaining causes are absent. A system 
is nonlinear if it is not linear. 


2. Time-invariant systems are characterized by the fact that system parameters 
do not change with time. The parameters of time-varying parameter systems 
change with time. 


3. For memoryless (or instantaneous) systems, the system response at any instant 
t depends only on the present value of the input (value at t). For systems with 
memory (also known as dynamic systems), the system response at any instant t 
depends not only on the present value of the input, but also on the past values 
of the input (values before t). 


4. In contrast, if a system response at t also depends on the future values of the 
input (values of input beyond t), the system is noncausal. In causal systems, 
the response does not depend on the future values of the input. Because of the 
dependence of the response on the future values of input, the effect (response) 


96 


1 Introduction to Signals and Systems 


of noncausal systems occurs before cause. When the independent variable is 
time (temporal systems), the noncausal systems are prophetic systems, and 
therefore, unrealizable, although close approximation is possible with some 
time delay in the response. Noncausal systems with independent variables 
other than time (e.g., space) are realizable. 

If the dimensions of system elements are small compared to the wavelengths of 
the signals, we may assume that each element is lumped at a single point in 
space, and the system may be considered as a lumped-parameter system. The 
signals under this assumption are functions of time only. If this assumption 
does not hold, the signals are functions of space and time; such a system is a 
distributed-parameter system. 

Systems whose inputs and outputs are continuous-time signals are continuous- 
time systems; systems whose inputs and outputs are discrete-time signals are 
discrete-time systems. If a continuous-time signal is sampled, the resulting 
signal is a discrete-time signal. We can process a continuous-time signal by 
processing the samples of this signal with a discrete-time system. 

Systems whose inputs and outputs are analog signals are analog systems; those 
whose inputs and outputs are digital signals are digital systems. 

If we can obtain the input f(t) back from the output y(t) of a system S by 
some operation, the system S is said to be invertible. Otherwise the system is 
noninvertible. 


The system model derived from a knowledge of the internal structure of the 


system is its internal description. In contrast, an external description of a system 
is its description as seen from the system’s input and output terminals; it can be 
obtained by applying a known input and measuring the resulting output. In the 
majority of practical systems, an external description of a system so obtained is 
equivalent to its internal description. In some cases, however, the external descrip- 
tion fails to give adequate information about the system. Such is the case with the 
so-called uncontrollable or unobservable systems. 


1.1-1 


ł.1-2 
1.1-3 
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Problems 


Find the energies of the signals illustrated in Fig. P1.1-1. Comment on the effect on 
energy of sign change, time shifting, or doubling of the signal. What is the effect on 
the energy if the signal is multiplied by k? 

Repeat Prob. 1.1-1 for the signals in Fig. P1.1-2. 

(a) Find the energies of the pair of signals z(t) and y(t) depicted in Figs. P1.1-3a 
and b. Sketch and find the energies of signals x(t) + y(t) and z(t) — y(t). Can you 
make any observation from these results? 
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Fig. P1.1-2 


x(t) y(t) 


m 
N 


0 L t—> 
0 2 it -1 
(a) 
x(t) y(t) 
1 1 
2n 2n 
0 T > 0 n t— 
(b) 
x(t) i) 
y 
1 1 
; o 
QO} 14 rears (c) 0 mt t—> 
Fig. P1.1-3 


(b) Repeat part (a) for the signal pair illustrated in Fig. P1.1-3c. Is your observation 
in part (a) still valid? 
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1.1-4 Find the power of the periodic signal f(t) shown in Fig. P1.1-4. Find also the powers 
and the rms values of: (a) —f(t) (b) 2f(t) (c) cf(t). Comment. 


f(t) 


Fig. P1.1-4 
1.1-5 Show that the power of a signal 
n n 
F) =Y Deet is P= D [Dil Fig. P1.3-3 
k=m k=m 


assuming all frequencies to be distinct, that is, wi # wx for alli Æ k 


1.1-6 Determine the power and the rms value for each of the following signals: 


(a) 10 cos (100% + ;) (b) 10 cos (100: + 4 +16 sin (150¢ y ) 
(c) (10+ 2 sin 3t) cos 10t (d) 10 cos 5t cos 10¢ 
(e) 10 sin 5t cos 10t (£) e1% cos wot 
1.3-1 In Fig. P1.3-1, the signal fı(t) = f(—t). Express signals f2(t), fs(t), fa(t), and fs(t) Fig. P1.4-2 


in terms of signals f(t), fi(t), and their time-shifted, time-scaled or time-inverted 


versions. For instance f2(t) = f(t- T) + fa(t— T). 1.4-1 Sketch the signals (a) u(t—5)—u(t—-7) (b) u(t—5)+u(t—7) (c) ¢?[u(t—1)—u(t—2)] 


(d) (t - 4)[u(t — 2) ~ u(t - 4)] 


fD 1.4-2 Express each of the signals in Fig. P1.4-2 by a single expression valid for all t. 

1.4-3 For an energy signal f(t) with energy Es, show that the energy of any one of the 
signals — f(t), f(-t) and f(t — T) is Ey. Show also that the energy of f(at) as well 
as f(at —b) is Ey/a. This shows that time-inversion and time-shifting does not affect 

= e vos signal energy. On the other hand, time compression of a signal (a > 1) reduces the 
energy, and time expansion of a signal (a < 1) increases the energy. What is the 
effect on signal energy if the signal is multiplied by a constant a? 
1 i) 1 ALO 1.4-4 Simplify the following expressions: 
sin t jw + F 6 
(a) (E5) 5(t) (b) (4 Tg) 5) 
-] 0 t—> 1 1 o 1 OSAR 
$ š (c) [e* cos (3t — 60°)] élt) (a) om Lat 2) 6(t - 1) 
Fig. P1.3-1 t44 
1 ; 
: 6(w+3 sin kw 
1.3-2 For the signal f(t) depicted in Fig. P1.3-2, sketch the signals: (a) f(-t) (b) f(t+6) (e) ( z) ene) o (So 
(e) f(3t) (A) FG) 
1.3-3 For the signal f(t) illustrated in Fig. P1.3-3, sketch (a) f(t—4) (b) (15) (c) f(-2) Hint: Use Eq. (1.23). For part (f) use L’'Hôpital’s rule. 


(d) f(2t - 4) (e) f(2-¢). 
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1.4-5 


1.4-6 


1.4-7 
1.4-8 


1.4-9 


-4-10 


4-11 
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Evaluate the following integrals: 


(a) T ôlr) f(t — r)dr (e) T 6(t + 3)je™ dt 


oo oo 


(b) J” iost- o [eroana 


(c) f sota (g) [10-00-04 
(a) f ot- asin ea (h) [Mees [5 (2 -5)] te 3) 


Hint: 6(z) is located at x = 0. For example, 5(1 — t) is located at 1 — t = 0, and so 
on. 

(a) Find and sketch df /dt for the signal f(t) shown in Fig. P1.3-3. 

(b) Find and sketch d? f/dt? for the signal f (t) depicted in Fig. P1.4-2a. 


Fig. P1.4-7 


Find and sketch fE f(x) dx for the signal f(t) illustrated in Fig. P1.4-7. 


Using the generalized function definition, show that 6(t) is an even function of t. 


Hint: Start with Eq. (1.24a) as the definition of 5(t). Now change variable t = —zx to 
show that 


J o(t)8(—t) dt = 9(0) 


Prove that 1 
6(at) = Ta) 
Hint: Show that = 
J soana = ieo 


Show that oo 
f È(t)(t) dt = —ġ(0) 


where ¢(t) and 6(t) are continuous at t = 0, and ¢(t) + 0 as t + too. This integral 
defines (t) as a generalized function. Hint: Use integration by parts. 


A sinusoid e@* cos wt can be expressed as a sum of exponentials e®* and e~* (Eq. 
(1.30c) with complex frequencies s = ø + jw and s = ø — jw. Locate in the com- 
plex plane the frequencies of the following sinusoids: (a) cos 3t (b) e~* cos 3t (c) 
e% cos 3t (d) e7” (e) e” (f) 5. 
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1.5-1 


1.6-1 


1.7-1 


1.7-2 


1.7-3 


Find and sketch the odd and the even components of (a) u(t) (b) tu(t) (c) sin wot u(t) 
(d) cos wot u(t) (e) sin wot (f) cos wot. : 
Write the input-output relationship for an ideal integrator. Determine the zero-input 
and zero-state components of the response. 


For the systems described by the equations below, with the input f(t) and output 
y(t), determine which of the systems are linear and which are nonlinear. 


(a) Ž + 2y(t) = P0) 


(c) 3y(t) +2 = f(t) 
dy 2 j 
(b) B+ 3tylt) = P(t) 


(1) 2 + (sin ule) = É + 2900) 


2 d d 
© (#) +200 = 109 (8) Gt 2U0) = 107 


CERT H= f sojar 


For the systems described by the equations below, with the input f(t) and output 
y(t), determine which of the systems are time-invariant parameter systems and which 
are time-varying parameter systems. 


(a) y(t) = f(t- 2) (d) y(t) = t f(t — 2) 
5 
= d 
(e) y(t) ES T 


w= (F 


For a certain LTI system with the input f(t), the output y(t) and the two initial 
conditions xı(0) and z2(0), following observations were made: 


(b) y(t) = f(-t) 


(c) y(t) = f (at) 


F(t) £1(0) £2(0) y(t) 


0 1 -1 e ‘u(t) 
0 2 1 e™(3t + 2)u(t) 
u(t) -1 -1 2u(t) 


Determine y(t) when both the initial conditions are zero and the input f(t) is as 
shown in Fig. P1.7-3. 

Hint: There are three causes: the input and each of the two initial conditions. Because 
of linearity property, if a cause is increased by a factor k, the response to that cause 
also increases by the same factor k. Moreover, if causes are added, the corresponding 
responses add. 
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1.7-4 A system is specified by its input-output relationship as 


ut) = P / (2) 


Show that the system satisfies the homogeneity property but not the additivity prop- 
erty. 


1.7-5 Show that the circuit in Fig. P1.7-5 is zero-state linear but is not zero-input linear. 
Assume all diodes to have identical (matched) characteristics. 
Hint: In zero state (when the initial capacitor voltage ve(0) = 0), the circuit is linear. 
If the input f(t) = 0, and v-(0) is nonzero, the current y(t) does not exhibit linearity 
with respect to its cause ve(0). 


y(t) 


f(t) 


Fig. P1.7-5 


1.7-6 The inductor L and the capacitor C in Fig. P1.7-6 are nonlinear, which makes the 
circuit nonlinear. The remaining 3 elements are linear. Show that the output y(t) of 
this nonlinear circuit satisfies the linearity conditions with respect to the input f(t) 
and the initial conditions (all the initial inductor currents and capacitor voltages). 
Recognize that a current source is an open circuit when the current is zero. 


f(t) 


Fig. P1.7-6 


1.7-7 For the systems described by the equations below, with the input f(t) and output 
y(t), determine which of the systems are causal and which are noncausal. 
(a) y(t) = f(t- 2) (c) y(t) = f(at) a>1 
(b) y(t) = f(-t) (d) y(t) = f(at) a<1 
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1.7-8 For the systems described by the equations below, with the input f(t) and output 
y(t), determine which of the systems are invertible and which are noninvertible. For + 
the invertible systems, find the input-output relationship of the inverse system. 


(c) y(t) = f(t) n, integer 


(a) y(t) = f f(r) dr 
ae (d) y(t) = cos [f (t) 


(b) y(t) = f(3t — 6) 


ry) G 


Fig. P1.8-1 Fig. P1.8-2 


1.8-1 For the circuit depicted in Fig. P1.8-1, find the differential equations relating outputs 
yi(t) and y2(t) to the input f(t). 
1.8-2 Repeat Prob. 1.8-1 for the circuit in Fig. P1.8-2. 


Fig. P1.8-3 


1.8-3 Water flows into a tank at a rate of qi units/s and flows out through the outflow valve 
at a rate of go units/s (Fig. P1.8-3). Determine the equation relating the outflow go 
to the input gi. The outflow rate is proportional to the head h. Thus go = Rh where 
R is the valve resistance. Determine also the differential equation relating the head 
h to the input qi. 

(Hint: The net inflow of water in time At is (qi — go)At. This inflow is also AAh 
where A is the cross section of the tank.) 


Time-Domain Analysis of 
Continuous-Time Systems 


In this book we consider two methods of analysis of linear time-invariant (LTI) 
systems: the time-domain method and the frequency-domain method. In this chap- 


ter we discuss the time-domain analysis of linear, time-invariant, continuous-time 
(LTIC) systems. 


2.1 Introduction 


For the purpose of analysis, we shall consider linear differential systems. 
This is the class of LTIC systems discussed in Chapter 1, for which the input f(t) 
and the output y(t) are related by linear differential equations of the form 


d"y d™ ly dy 
qa t lni ac Koner Bis + agy(t) = 
d™f aml df 
bm Gym + Pm- aay $e tba + bof (t) (2.1a) 


where all the coefficients a; and b; are constants. Using operational notation D to 
represent d/dt, we can express this equation as 


(D” + anp-1D" 1 +++» + 01D +49) y(t) 
= (bmD™ + bm—1D™ 1 +++. +b1D +b) f(t) (2.1b) 


or 
Q(D)y(t) = P(D)f(t) (2.1¢) 

where the polynomials Q(D) and P(D) are 
Q(D) = D” +an-1D""! +---+0,D + ag (2.2a) 
P(D) = bmD™ + bm—1D™ |! +... +.b1D + bo (2.2b) 
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Theoretically the powers m and n in the above equations can take on any 
value. Practical noise considerations, however, require m < n. Noise is any un-, 
desirable signal, natural or manmade, which interferes with the desired signals in 
the system. Some of the sources of noise are: the electromagnetic radiation from 
stars, random motion of electrons in system components, interference from nearby 
radio and television stations, transients produced by automobile ignition systems, 
fluorescent lighting, and so on. We show in Chapter 6 that a system specified by 
Eq. (2.1) behaves as an (m — n)th-order differentiator of high-frequency signals if 
m >n. Unfortunately, noise is a wideband signal containing components of all fre- 
quencies from 0 to oo. For this reason noise contains a significant amount of rapidly 
varying components with derivatives that are, consequently, very large. Therefore, 
any system specified by Eq. (2.1) in which m > n will magnify the high-frequency 
components of noise through differentiation. It is entirely possible for noise to be 
magnified so much that it swamps the desired system output even if the noise sig- 
nal at the system’s input is tolerably small. For the rest of this text we assume 
implicitly that m < n. For the sake of generality we shall assume m = n in Eq. 
(2.1). 

In Chapter 1, we demonstrated that a system described by Eq. (2.1) is lin- 
ear.t Therefore, its response can be expressed as the sum of two components: the 
zero-input component and the zero-state component (decomposition property).t 
Therefore, 


Total response = zero-input response + zero-state response (2.3) 


The zero-input component is the system response when the input f(t) = 0 so 
that it is the result of internal system conditions (such as energy storages, initial 
conditions) alone. It is independent of the external input f(t). In contrast, the 
zero-state component is the system response to the external input f(t) when the 
system is in zero state, meaning the absence of all internal energy storages; that is, 
all initial conditions are zero. 


{To demonstrate that any system described by Eq. (2.1) is linear, let the input f(t) to the system 
generate the output yi(¢), and another input fo(t) generate the output y2(t). From Eq. (2.1c) it 
follows that 


Q(D)u(t) = P(D)fi(t) and Q(D) ya(t) = P(D) fa(t) 
Multiplication of these equations by kı and k2, respectively and then adding yields 
Q(D) [kiya (t) + kzy2(t)] = P(D) [kı fi(t) + kofo(t)] 


This equation shows that the input kı fı(t) + k2fe(t) generates the response kiyi(t) + keyo(t). 
Therefore, the system is linear 


f We can verify readily that the system described by Eq. (2.1) has the decomposition property. 
If yo(t) is the zero-input response, then, by definition, 


Q(D)yo(t) = 0 
Tf y(t) is the zero-state response, then y(t) is the solution of 
Q(D)y(t) = P(D) f(t) 
subject to zero initial conditions (zero-state). The addition of these two equations yields 
Q(D) lyo(t) + y(4)] = P(D) F(t) 
Clearly, yo(t) + y(t) is the general solution of Eq. (2.1). 
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2.2 System Response to Internal Conditions: Zero-Input Response 


‘ ag zero-input response yo(t) is the solution of Eq. (2.1) when the input f(t) = 
so that 


X Q(D)yo(t) = 0 (2.4a) 
(D” +an-1D""! +. +a,D + ao) yo(t) = 0 (2.4b) 
A solution to this equation can be obtained systematically.1 However, we will take 
a short cut by using heuristic reasoning. Equation (2.4b) shows that a linear com- 
bination of yo(t) and its n successive derivatives is zero, not at some values of t, 
but for all t. Such a result is possible if and only if yo(t) and all its n successive 
derivatives are of the same form. Otherwise their sum can never add to zero for all 


values of t. We know that only an exponential function eò has this property. So 
let us assume that 


yo(t) = ce 


is a solution to Eq. (2.4b). Then 


my 
dt? 
Substituting these results in Eq. (2.4b), we obtain 
c (A + an_1A"7) + +++ +a +49) e** = 0 
For a nontrivial solution of this equation, 


A? an-A ees Fad tap =0 (2.5a) 
This result means that ce** is indeed a solution of Eq. (2.4), provided that A satisfies 


Eq. (2.5a). Note that the polynomial in Eq. (2.5a) is identical to the polynomial 
Q(D) in Eq. (2.4b), with A replacing D. Therefore, Eq. (2.5a) can be expressed as 


Q(A) =0 (2.5b) 
When Q(A) is expressed in factorized form, Eq. (2.5b) can be represented as 


Q(A) = (A = Ar) = Az) ++ (A= An) = 0 (2.5c) 
Clearly, À hasn solutions: A1, A2,... , Àn. Consequently, Eq. (2.4) has n possible 
solutions: cjeòt, czeò?t, ..., cneò™”t, with c1, c2, ..., Cn as arbitrary constants. We 


can readily show that a general solution is given by the sum of these n solutions,t 


so that 
yo(t) = cye™* + cge™?t +... + enet (2.6) 


where c1, cg, ..- , Cn are arbitrary constants determined by n constraints (the 
auxiliary conditions) on the solution. 


+ To prove this assertion, assume that y1 (t), y2(é), ---, yn(t) are all solutions of Eq. (2.4). Then 
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Observe that the polynomial Q(A), which is characteristic of the system, has 
nothing to do with the input. For this reason the polynomial Q(A) is called the 
characteristic polynomial of the system. The equation . 


Q(A) =0 (2.7) 
is called the characteristic equation of the system. Equation (2.5c) clearly indi- 
cates that 1, A2, ..., An are the roots of the characteristic equation; consequently, 
they are called the characteristic roots of the system. The terms characteristic 
values, eigenvalues, and natural frequencies are also used for characteristic 
roots. The exponentials e**(i = 1,2,...,n) in the zero-input response are the 
characteristic modes (also known as modes or natural modes) of the sys- 
tem. There is a characteristic mode for each characteristic root of the system, and 
the zero-input response is a linear combination of the characteristic modes of the 
system. 

The single most important attribute of an LTIC system is its characteristic 
modes. Characteristic modes not only determine the zero-input response but also 
play an important role in determining the zero-state response. In other words, the 
entire behavior of a system is dictated primarily by its characteristic modes. In the 
rest of this chapter we shall see the pervasive presence of characteristic modes in 
every aspect of system behavior. 


Repeated Roots 

The solution of Eq. (2.4) as given in Eq. (2.6) assumes that the n characteristic 
roots A1, \g,.-., An are distinct. If there are repeated roots (same root occurring 
more than once), the form of the solution is modified slightly. By direct substitution 
we can show that the solution of the equation 


(D — d)®yo(t) = 0 
is given by 
yo(t) = (c1 + cat)e™* 
In this case the root \ repeats twice. Observe that the characteristic modes in this 


case are e% and te**. Continuing this pattern, we can show that for the differential 
equation 


(D — A)" yo(t) = 0 (2.8) 
the characteristic modes are e%, teòt, t?eòt, ..., t”~4e**, and that the solution is 
yo(t) = (c1 teat +++» + ert”) e™ (2.9) 


Q(D)yi(t) = 0 
Q(D)ya(t) = 0 
Q(D)yn(t) = 0 
Multiplying these equations by c1,c2,...,¢n, respectively, and adding them together yields 
Q(D) [erys (t) + czy2(t) +- + enyn(t)] = 0 
This result shows that cyyi(t) + c2ya(t) + -> + cnyn(t) is also a solution of the homogeneous 
equation (2.4). 
f The term eigenvalue is German for characteristic value. 
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Consequently, for a system with the characteristic polynomial 


Q(A) = (A = Ar)" = Arta) (A = An) 


the characteristic modes are e*!*, te*2*, ..., Olet, errtit, ..., eA»? and the 
solution is 


yo(t) = (c1 + cat +++ + cpt” e + erpe t + +++ + enert 


Complex Roots 

The procedure for handling complex roots is the same as that for real roots. 
For complex roots the usual procedure leads to complex characteristic modes and 
the complex form of solution. However, it is possible to avoid the complex form 
altogether by selecting a real form of solution, as described below. 

For a real system, complex roots must occur in pairs of conjugates if the coef- 
ficients of the characteristic polynomial Q(A) are to be real. Therefore, if a + jG 
is a characteristic root, a — 72 must also be a characteristic root. The zero-input 
response corresponding to this pair of complex conjugate roots is 


yo(t) = celti) + epe(o- 0) (2.10) 


For a real system, the response yo(t) must also be real. This is possible only if cı 
and cg are conjugates. Let 


a = sen and = cy = =e? 
This yields 


yo(t) = serena + se deet tet 
= sem [este 4 emiten] 
= ce% cos (Bt + 0) (2.10b) 


Therefore, the zero-input response corresponding to complex conjugate roots a+ jß 
can be expressed in a complex form (2.10a) or a real form (2.10b). The latter is 
more convenient from a computational viewpoint because it avoids dealing with 
complex numbers. 


@ Example 2.1 
(a) Find yo(), the zero-input component of the response for an LTI system described 
by the following differential equation: 


(D? + 3D + 2) y(t) = DFC) 


when the initial conditions are yo(0) = 0, yo(0) = —5. Note that yo(t), being the zero-input 
component (f(t) = 0), is the solution of (D? + 3D + 2)yo(t) = 0. 

The characteristic polynomial of the system is \7+3\+2. The characteristic equation 
of the system is therefore A? + 3A-+2 = (A+1)(A+2) = 0. The characteristic roots of the 
system are \1 = —1 and \2 = —2, and the characteristic modes of the system are e™* and 
e™?t, Consequently, the zero-input component of the loop current is 


yo(t) = ce + c2e7™ (2.11a) 
To determine the arbitrary constants cı and ce, we differentiate Eq. (2.11a) to obtain 
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yo(t) = —cie* — 2coe~** (2.11b) 


Setting t = 0 in Eqs. (2.11a) and (2.11b), and substituting the initial conditions yo(0) = 6 
and yo(0) = —5 we obtain 


0=c1 +e 


—5 = —c1 — 2c2 
Solving these two simultaneous equations in two unknowns for cı and c2 yields 


cy = —5, c2 =5 


Therefore 
yo(t) = —Be *+5e 7 


This is the zero-input component of y(t) for t > 0. 


(b) Similar procedure may be followed for repeated roots. For instance, for a system 
specified by 


(D? + 6D +9) y(t) = (3D + 5) f(t) 
let us determine yo(t), the zero-input component of the response if the initial conditions 
are yo(0) = 3 and yo(0) = —7. 

The characteristic polynomial is A? + 6\ +9 = (A +3)’, and its characteristic roots 
are 41 = —3, Az = —3 (repeated roots). Consequently, the characteristic modes of the 
system are e`% and te~%t. The zero-input response, being a linear combination of the 
characteristic modes, is given by 


yo(t) = (c1 + cet)e~™* 


We can find the arbitrary constants cı and c2 from the initial conditions yo(0) = 3 and 
ýo(0} = —7 following the procedure in part (a). The reader can show that cı = 3 and 
c2 = 2. Hence, 

yo(t) = (3 + 2t)e"** t>0 


(c) For the case of complex roots, let us find the zero-input response of an LTI system 
described by the equation: 


(D? + 4D +40) y(t) = (D + 2) f(t) 


with initial conditions yo(0) = 2 and yo(0) = 16.78. 

The characteristic polynomial is A? + 4. +40 = (A +2 — j6)(à +2 + j6). The 
characteristic roots are —2 + j6.t The solution can be written either in the complex form 
(2.10a) or in the real form (2.10b). The complex form is yo(t) = ciet + cge*2*, where 
di = —2 + 96 and A2 = —2 — j6. Since a = —2 and 6 = 6, the real form solution is {see 
Eq. (2.10b)] 


yo(t) = ce ** cos (6t + 8) (2.12a) 


+The complex conjugate roots of a second-order polynomial can be determined by using the formula 
in Sec. B.7-10 or by expressing the polynomial as a sum of two squares. The latter can be 
accomplished by completing the square with the first two terms, as shown below: 


A2 44A + 40 = (A? + 4A + 4) +36 = (A+ 2)? + (6)? = (A +2 — J6)(A + 2 + j6) 
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where c and @ are arbitrary constants to be determined from the initial conditions yo(0) = 2 
and yo(0) = 16.78. Differentiation of Eq. (2.12a) yields 


yo(t) = —2ce** cos (6t + 0) — Gce~™ sin (6¢ + 6) (2.12b) 
Setting t = 0 in Eqs. (2.12a) and (2.12b), and then substituting initial conditions, we 
obtain 
2 = ccos 6 
16.78 = ~2c cos 6 — 6csin 8 
Solution of these two simultaneous equations in two unknowns ccos @ and csin 6 yields 
ccos 6 =2 (2.13a) 


: csin 0 = —3.463 (2.13b) 
Squaring and then adding the two sides of the above equations yields 


ce? = (2)? + (-3.464)? = 16 = c= 4 
Next, dividing (2.13b) by (2.13a); that is dividing csin @ by ccos @ yields 


— —3.463 
tan 0 = == 


and 
6 = tan”! (=3483) =-3 
Therefore 
yo(t) = 4e~** cos (6t - 3) 
Figure B.11c shows the plot of yo(t). E 


© Computer Example C2.1 
Find the roots of polynomial A? + 4A + 40 
a=[1 4 40]; r= roots(a) 
r=-2.0000 + 6.0000i 
-2.0000 - 6.0000i © 


© Computer Example C2.2 
For an LTIC system specified by the differential equation 
(D? +4D + k)y(t) = (3D + 5) f(t) 


determine the zero-input component of the response if the initial conditions are yo(0) = 3, 
and yo(0) = —7 for two values of k: (a) 3 (b) 4 (c) 40. 


(a) y0=dsolve(’D2y+4*Dy+3*y=0',’y(0)=3’,’Dy(0)=-7’,’t’) 
yO = 2texp(~3*t)+exp(-t) 

(b) y0=dsolve(’D2y+4*Dy+4*y=0’,’y(0)=3’,’Dy(0)=-7’,’t’) 
yO = 3*exp(-2*t)-exp(-2t) +t 

(e) y0=dsolve(*D2y+4*Dy+40*y=0’,’y(0)=3’,’Dy(0)=-7’,’t’) 
yO = 3*exp(-2*t) *cos(6*t)-1/6*exp(-2t) *sin(6+*t) © 


A Exercise E2.1 


Find the zero-input response of an LTIC system described by (D+ 5)y(t) = f(t) if the initial 
condition is y(0) = 5. 


Answer: yo(t)=5e-5* t>0 y 


A Exercise E2.2 
Solve 


(D? + 2D) yo(t) = 0 
if yo(0) = 1 and ġo(0) = 4. Hint: The characteristic roots are 0 and —2. 
Answer: yo(t) = 3 — 2e7?t t>o0 y 


2.2 System Response to Internal Conditions: Zero-Input Response ill 


Practical Initial Conditions and the meaning of 07 and 0+ 


In Example 2.1 the initial conditions yo(0) and yo(0) were supplied. In practical 
problems, we must derive such conditions from the physical situation. For instance, 
in an RLC circuit, we may be given the conditions, such as initial capacitor volt- 
ages, and initial inductor currents, etc. From this information, we need to derive 
yo(0), yo(0), --- for the desired variable as demonstrated in the next example. 

In much of our discussion, the input is assumed to start at t = 0, unless oth- 
erwise mentioned. Hence, t = 0 is the reference point. The conditions immediately 
before t = 0 (just before the input is applied) are the conditions at t = 07, and 
those immediately after t = 0 (just after the input is applied) are the conditions at 
t = 0+ (compare this with the historical time frame B.C. and A.D.). In practice, 
we are likely to know the initial conditions at t = 07 rather than at t = 0+. The 
two sets of conditions are generally different, although in some cases they may be 
identical. 

We are dealing with the total response y(t), which consists of two components; 
the zero-input component yo(t) (response due to the initial conditions alone with 
f(t) = 0) and the zero-state component resulting from the input alone with all 
initial conditions zero. At t = 07, the response y(t) consists solely of the zero-input 
component yo(t) because the input has not started yet. Hence the initial conditions 
on y(t) are identical to those of yo(t). Thus, y(0~) = yo(0~), (07) = yo(07), and 
so on. Moreover, yo(t) is the response due to initial conditions alone and does not 
depend on the input f(t). Hence, application of the input at t = 0 does not affect 
yo(t). This means the initial conditions on yo(t) at t = 07 and 0* are identical; that 
is yo(O~), yo(O-), -++ are identical to yo(0*), yo(Ot), --+, respectively. It is clear 
that for yo(t), there is no distinction between the initial conditions at t = 07, 0 
and 0+. They are all the same. But this is not the case with the total response 
y(t), which consists of both, the zero-input and the zero-state components. Thus, 
in general, y(0~) Æ y(0*), y(0~) 4 y(0*), and so on. 


a Example 2.2 

A voltage f(t) = 10e7**u(t) is applied at the input of the RLC circuit illustrated in 
Fig. 2.1a. Find the loop current y(t) for t > 0 if the initial inductor current is zero; that 
is, y(07) = 0 and the initial capacitor voltage is 5 volts; that is, ve(07) = 5. 

The differential (loop) equation relating y(t) to f(t) was derived in Eq. (1.55) as 


(D? + 3D + 2) y(t) = Df(t) 


The zero-state component of y(t) resulting from the input f(t), assuming that all initial 
conditions are zero; that is, y(0~) = vc(0~) = 0, will be obtained later in Example 2.5. In 
this example we shall find the zero-input component yo(t). For this purpose, we need two 
initial conditions yo(0) and yo(0). These conditions can be derived from the given initial 
conditions, y(0~) = 0 and vc(0~) = 5, as follows. Recall that yo(t) is the loop current 
when the input terminals are shorted at t = 0, so that the input f(t) = 0 (zero-input) as 
depicted in Fig. 2.1b. We now compute yo(0) and yo(0), the values of the loop current and 
its derivative at t = 0, from the initial values of the inductor current and the capacitor 
voltage. Remember that the inductor current cannot change instantaneously in the absence 
of an impulsive voltage. Similarly, the capacitor voltage cannot change instantaneously in 
the absence of an impulsive current. Therefore, when the input terminals are shorted at 
t = 0, the inductor current is still zero and the capacitor voltage is still 5 volts. Thus, 


yo(0) =0 
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Fig. 2.1 


To determine yo(Q), we use the loop equation for the circuit in Fig. 2.1b. Because the 
voltage across the inductor is L(dyo/dt) or yo(t), this equation can be written as follows: 


olt) + 8yo(t) + vc(t) = 0 
Setting t = 0, we obtain 


Yo(0) + 3yo(0) + vc(0) = 0 (2.14) 
But yo(0) = 0 and vc(0) = 5. Consequently, 
yo(0) = —5 


Therefore, the desired initial conditions are 

yo(0)=0 and yo(0)=—-5 
Thus, the problem reduces to finding yo(t), the zero-input component of y(t) of the system 
specified by the equation (D? + 3D + 2)y(t) = Df(t), when the initial conditions are 
yo(0) = 0 and yo(O) = ~—5. We have already solved this problem in Example 2.1a, where 
we found 

yo(t)=—-5e + 5e” t20 (2.15) 


This is the zero-input component of the loop current y(t). 

It will be interesting to find the initial conditions at t = 07 and OF for the total 
response y(t). Let us compare y(0~) and y(0~) with y(0+) and y(0*). The two pairs can 
be compared by writing the loop equation for the circuit in Fig. 2.1a at t = 07 and t = OT. 
The only difference between the two situations is that at t = 07, the input f(t) = 0, 
whereas at t = O*, the input f(t) = 10 (because f(t) = 10e~**), Hence, the two loop 
equations are 


y(O~) + 3y(07) + vc(07) = 0 
y(0T) +3y(0*) + ve(0*) = 10 


The loop current y(0+) = y(07) = 0 because it cannot change instantaneously in the 
absence of impulsive voltage. The same is true of the capacitor voltage. Hence, vc(0*) = 
vc(07) = 5. Substituting these values in the above equations, we obtain y(0~) = —5 and 
y(0t) = 5. Thus 

y(0™) =0, ġ(07)=-5 and y(0*)=0, y(07) =5 (2.16) 


a 
A Exercise E2.3 
In the circuit in Fig. 2.la, the inductance L = 0 and the initial capacitor voltage vc(0) = 30 
volts. Show that the zero-input component of the loop current is given by yo(t) = —10e72%t/3 for 
t20. V7 
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Independence of Zero-Input and Zero-State Response 

In this example we computed the zero-input component without using the input 
f(t). The zero-state component can be computed from the knowledge of the input 
f(t) alone; the initial conditions are assumed to be zero (system in zero state). The 
two components of the system response (the zero-input and zero-state components) 
are independent of each other. The two worlds of zero-input response and zero-state 
response coexist side by side, neither of them knowing or caring what the other is 
doing. For each component, the other is totally irrelevant. 


Role of Auxiliary Conditions in Solution of Differential Equations 


Solution of a differential equation requires additional pieces of information (the 
auxiliary conditions). Why? We now show that a differential equation does not, 
in general, have a unique solution unless some additional constraints (or conditions) 
on the solution are known. The reason is that, as explained in the discussion on 
invertibility (Sec. 1.7), the differentiation operation is not invertible unless one piece 
of information about y(t) is given. Thus, differentiation is an irreversible (noninvert- 
ible) operation during which certain information is lost. To invert this operation, 
one piece of information about y(t) must be provided to restore the original y(t). 
Using a similar argument, we can show that, given d?y/dt?, we can determine y(t) 
uniquely only if two additional pieces of information (constraints) about y(t) are 
given. In general, to determine y(t) uniquely from its nth derivative, we need n 
additional pieces of information (constraints) about y(t). These constraints are also 
called auxiliary conditions. When these conditions are given at t = 0, they are 
called initial conditions. 


2.2-1 Some Insights into the Zero-Input Behavior of a System 


By definition, the zero-input response is the system response to its internal 
conditions, assuming that its input is zero. Understanding this phenomenon pro- 
vides interesting insight into system behavior. If a system is disturbed momentarily 
from its rest position and if the disturbance is then removed, the system will not 
come back to rest instantaneously. In general, it will come back to rest over a 
period of time and only through a special type of motion that is characteristic of 
the system.} For example, if we press on an automobile fender momentarily and 
then release it at t = 0, there is no external force on the automobile for t > Ot. 
The auto body will eventually come back to its rest (equilibrium) position, but not 
through any arbitrary motion. It must do so using only a form of response which 
is sustainable by the system on its own without any external source, because the 
input is zero. Only characteristic modes satisfy this condition. The system uses a 
proper combination of characteristic modes to come back to the rest position while 
satisfying appropriate boundary (or initial) conditions. 

If the shock absorbers of the automobile are in good condition (high damping 
coefficient), the characteristic modes will be monotonically decaying exponentials, 
and the auto body will come to rest rapidly without oscillation. In contrast, for 


f This assumes that the system will eventually come back to its original rest (or equilibrium) 
position. 

t We ignore the force of gravity, which merely causes a constant displacement of the auto body 
without affecting the other motion. 
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fog 


Fig. 2.2 Modes always get a free ride. 


poor shock absorbers (low damping coefficients), the characteristic modes will be 
exponentially decaying sinusoids, and the body will come to rest through oscilla- 
tory motion. When a series RC circuit with an initial charge on the capacitor is 
shorted, the capacitor will start to discharge exponentially through the resistor. 
This response of the RC circuit is caused entirely by its internal conditions and is 
sustained by this system without the aid of any external input. The exponential 
current waveform is therefore the characteristic mode of this RC circuit. 

Mathematically we know that any combination of characteristic modes can be 
sustained by the system alone without requiring an external input. This fact can 
be readily verified for the series RL circuit shown in Fig. 2.2. The loop equation 
for this system is 


(D + 2)y(t) = f(t) 
It has a single characteristic root à = —2, and the characteristic mode is e~**. We 
now verify that a loop current y(t) = ce~*4 can be sustained through this circuit 
without any input voltage. The input voltage f(t) required to drive a loop current 
y(t) = ce~** is given by 


f(t) = 1 + Ryl) 


d 
= gee’ + 2ce7” 


= —2ce7? + 2ce7% 
=0 


Clearly, the loop current y(t) = ce~*# is sustained by the RL circuit on its own, 


without the necessity of an external input. 


The Resonance Phenomenon 

We have seen that any signal consisting of a system’s characteristic modes is 
sustained by the system on its own; the system offers no obstacle to such signals. 
Imagine what would happen if we actually drove the system with an external input 
that is one of its characteristic modes. This would be like pouring gasoline on a fire 
in a dry forest or hiring an alcoholic to taste liquor. An alcoholic would gladly do the 
job without pay. Think what will happen if he were paid by the amount of liquor he 
tasted! The system response to characteristic modes would naturally be very high. 
We call this behavior the resonance phenomenon. An intelligent discussion of 
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this important phenomenon requires an understanding of the zero-state response; 
for this reason we postpone this topic until Sec. 2.7-7. 


2.3 The Unit Impulse Response h(t) 


The impulse function 6(t) is also used in determining the response of a linear 
system to an arbitrary input f(t). In Chapter 1 we explained how a system response 
to an input f(t) may be found by breaking this input into narrow rectangular 
pulses, as illustrated in Fig. 1.27a, and then summing the system response to all 
the components. The rectangular pulses become impulses in the limit as their 
widths approach zero. Therefore, the system response is the sum of its responses 
to various impulse components. This discussion shows that if we know the system 
response to an impulse input, we can determine the system response to an arbitrary 
input f(t). We now discuss a method of determining h(t), the unit impulse response 
of an LTIC system described by the nth-order differential equation 


Q(D)y(t) = P(D) f(t) (2.17a) 


where Q(D) and P(D) are the polynomials shown in Eq. (2.2). Recall that noise 
considerations restrict practical systems to m < n. Under this constraint, the most 
general case is m = n. Therefore, Eq. (2.17a) can be expressed as 


(D° +an-1D™! +--+» 4+01D + ag)y(t) = 
(bn D” + bn_1D""! + --- +b1D + bo) f(t) (2.17b) 


Before deriving the general expression for the unit impulse response h(t), it is 
illuminating to understand qualitatively the nature of h(t). The impulse response 
h(t) is the system response to an impulse input 6(t) applied at t = 0 with all the 
initial conditions zero at t = 07. An impulse input 6(t) is like lightning, which 
strikes instantaneously and then vanishes. But in its wake, in that single moment, 
lightning rearranges things where it strikes. Similarly, an impulse input 6(t) appears 
momentarily at t = 0, and then it is gone forever. But in that moment it generates 
energy storages; that is, it creates nonzero initial conditions instantaneously within 
the system at t = 0+. Although the impulse input (t) vanishes for t > 0 so that the 
system has no input after the impulse has been applied, the system will still have a 
response generated by these newly created initial conditions. The impulse response 
h(t), therefore, must consist of the system’s characteristic modes for t > OT. Asa 
result 

h(t) = characteristic mode terms t>0r 


This response is valid for t > 0. But what happens at t = 0? At a single moment 
t = 0, there can at most be an impulset, so the form of the complete response h(t) 
is given by 


t It might be possible for the derivatives of 6(t) to appear at the origin. However, if m < n, 
it is impossible for h(t) to have any derivatives of 6(t). This conclusion follows from Eq. (2.17b) 
with f(t) = 6(t) and y(t) = k(t). The coefficients of the impulse and all of its derivatives must 
be matched on both sides of this equation. If h(t) contains 6) (t), the first derivative of 6(t), the 
left-hand side of Eq. (2.17b) will contain a term 6("+1)(¢), But the highest-order derivative term 
on the right-hand side is 6(*)(t). Therefore, the two sides cannot match. Similar arguments can 
be made against the presence of the impulse’s higher-order derivatives in h(t). 
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h (t) = Aod(t) + characteristic mode terms t>0 (2.18) 


The detailed derivation of h(t) is neither illuminating nor necessary for our future 
development, so to prevent needless distraction, this derivation is placed in Appen- 
dix 2.1 at the end of the chapter. There, we show that for an LTIC system specified 
by Eq. (2.17), the unit impulse response A(t) is given by 

h(t) = 6, 6(t) + [P(D) yn(t)] u(t) (2.19) 


where bn is the coefficient of the nth-order term in P(D) [see Eq. (2.17b)], and 
yn(t) is a linear combination of the characteristic modes of the system subject to 
the following initial conditions: 
yr P(0) = 1, and yn(0) = gn(0) = ğn(0) == 470) =0 (2.20) 

where y (0) is the value of the kth derivative of yn(t) at t = 0. We can express 
this condition for various values of n (the system order) as follows: 

n=1: yn(0)=1 

n=2: Yyn(0)=0 and yn(0) =1 

n=3: Yn(0) =ğýn(0)=0 and ğn(0)=1 

n=4: Yn(0) = ýn(0) = ğn(0) =0 and ¥,(0) =1 (2.21) 


and so on. 
If the order of P(D) is less than the order of Q(D), bn = 0, and the impulse 
term b,6(t) in h(t) is zero. 


@ Example 2.3 
Determine the unit impulse response A(t) for a system specified by the equation 


(D? + 3D + 2) y(t) = Df(t) (2.22) 
This is a second-order system (n = 2) having the characteristic polynomial 
(A? + 8A +2) = (A+1)(A +2) 
The characteristic roots of this system are \ = —1 and à = —2. Therefore 
yn(t) = cie~* + coe (2.23a) 
Differentiation of this equation yields 
gn(t) = —cie7* — 2cge** (2.23b) 
The initial conditions are [see Eq. (2.21) for n = 2] 
Yn(0)=1 and = yn(0) =0 


Setting ¢ = 0 in Eqs. (2.23a) and (2.23b), and substituting the above initial conditions, we 
obtain 

O=ca +e? 

1 = -c1 — 2c2 (2.24) 
Solution of these two simultaneous equations yields 
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es and c2=-1 * 

Therefore 
yn(t) = e™ — e7” (2.25) 


Moreover, according to Eq. (2.22), P(D) = D, so that 
P(D)yn(t) = Dyn(t) = gn(t) = ~e7* + 267” 
Also in this case, bn = b2 = 0 [the second-order term is absent in P(D)]. Therefore 
A(t) = bn6(t) + [P(D)yn(t)]u(t) = (e + 2e7**)u(t) W (2.26) 


Comment 

In the above discussion, we have assumed m < n, as specified by Eq. (2.17b). 
Appendix 2.1 shows that the expression for h(t) applicable to all possible values of 
m and n is given by 


h(t) = P(D)[yn(t)u(t)] 
where yn(t) is a linear combination of the characteristic modes of the system subject 
to initial conditions (2.20). This expression reduces to Eq. (2.19) when m < n. 
Determination of the impulse response h(t) using the procedure in this section 


is relatively simple. However, in Chapter 6 we shall discuss another, even simpler 
method using the Laplace transform. 


A Exercise E2.4 
Determine the unit impulse response of LTIC systems described by the equations: 
(a) (D+ 2)y(t) = (3D +5)f(t) 
(b) D(D + 2)y(t) = (D+ 4) f(t) 
(c) (D?+2D+1)y(t) = Df(t) 


Answers: (a) 36(t) — e~**u(t) (b) (2—e7#)u(t) (c) (1—tetu(t) y 


© Computer Example C2.3 


Determine the impulse response h(t) for an LTIC system specified by the differential 
equation 


(D? + 3D + 2)y(t) = Df(t) 


This is a second-order system with bn = b2 = 0. First we find the zero-input component 
for initial conditions y(07) = 0, and y(07) = 1 
Yzi=dsolve(’D2y+3*Dy+2*y=0’,’y(0)=0’,’Dy(0)=1’,’t’) 
Yzi = -exp(-2+*t)+exp(-t) 
Since P(D) = D, we differentiate the zero-input response: 
PYzi=symdiff(Yzi) 
PYzi = 2*exp(-2*t)-exp(-t) 


Therefore 


h(t) = b26(t) + [Dyo(t)]u(t) = (2e-* - e) G) 
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System Response to Delayed Impulse 

If h(t) is the response of an LTIC system to the input 6(t), then h(t—T) is the 
response of this same system to the input (t — T). This conclusion follows from 
the time-invariance property of LTIC systems. Thus, by knowing the unit impulse 
response h(t), we can determine the system response to a delayed impulse 6(¢ — T). 


2.4 System Response to External Input: Zero-state Response 


This section is devoted to the determination of the zero-state response of an 
LTIC system. This is the system response y(t) to an input f (t) when the system 
is in zero state; that is, when all initial conditions are zero. We shall assume 
that the systems discussed in this section are in zero state unless men- 
tioned otherwise. Under these conditions, the zero-state response will be the 
total response of the system. 

We shall use the superposition principle here to derive a linear system’s re- 
sponse to some arbitrary input f(t). In this approach, we express f (t) in terms 
of impulses. We begin by approximating f(t) with narrow rectangular pulses, as 
depicted in Fig. 2.3a. This procedure gives us a staircase approximation of f(t) that 
improves as pulse width is reduced. In the limit as pulse width approaches zero, this 
representation becomes exact, and the rectangular pulses become impulses delayed 
by various amounts. The system response to the input f(t) is then given by the sum 
of the system’s responses to each (delayed) impulse component of f(t). In other 
words, we can determine y(t), the system response to any arbitrary input f(t), if 
we know the impulse response of the system. 

For the sake of generality, we place no restriction on f(t) as to where it starts 
and where it ends. It is therefore assumed to exist for all time, starting at t = —oo. 
The system’s total response to this input will then be given by the sum of its 
responses to each of these impulse components. This process is illustrated in Fig. 
2.3. 

Figure 2.3a shows f(t) as a sum of rectangular pulses, each of width Ar. In 
the limit as Ar — 0, each pulse approaches an impulse having a strength equal to 
the area under that pulse. For example, as Ar — 0, the shaded rectangular pulse 
located at t = nAr in Fig. 2.3a will approach an impulse at the same location with 
strength f(nAr)Ar (the shaded area under the rectangular pulse). This impulse 
can therefore be represented by [f(nAr)Ar]6(t — nAr), as shown in Fig. 2.3d. 

If the system’s response to a unit impulse 6(t) is h(t) (Fig. 2.3b), its response 
to a delayed impulse 6(t ~ nAr) will be h(t — nAr) (Fig. 2.3c). Consequently, 
she system’s response to [f(nAr)Ar]6(t —nAr) will be [f(nAr)Ar]a(t—nAr), as 
dlustrated in Fig. 2.3d. These results can be conveniently displayed as input-output 
pairs with an arrow directed from the input to the output as shown below. The left- 
qand side represents the input, and the right-hand side represents the corresponding 
system response: 


6(t) = A(t) 
6(t-nAr) = h(t- når?) 
[f(nAr)Ar]6(t-nAr) = [f(nAr)Ar]h(t -nAr) (2.27) 


input output 
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(a) 


h(t) 
ô (t) 


5 (t - nåt) 


h(t - nAt) 


(c) 


= [f(nAt) At ]8 (t - nAt) 


Ay(t) f(nAt) h(t - nAt)At 


(d) 


(e) 


Fig. 2.3 Finding the system response to an arbitrary input f(t). 
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This display shows the input-output pairs in Figs. 2.3b, c, and d, respectively. The 
last pair represents the system response to only one of the impulse components 
of f(t). The total response y(t) is obtained by summing all such components as 
depicted in Fig. 2.3e. Summing on both sides of the above display yields (with 
Ar > 0) 


oo co 
im, Y f(nAr)6(t-nAr)Ar = Jim XO f(nAr)a(t-—nAr)Ar 
n=~0o n=- 


The input f(t) The output y(t) 


The left-hand side is the input f(t) represented as a sum of all the impulse compo- 
nents in a manner illustrated in Fig. 2.3a. The right-hand side is the output y(t) 
represented as a sum of the output components as shown in Fig. 2.3e. Both the 
left-hand side and the right-hand side, by definition, are integrals given by} 


a f(r)6(t —r)dr => I f(r)h(t — 7) dr (2.28) 
—— ee ———— 
f(t) y(t) 


The left-hand side expresses the input f(t) as made up of the impulse components 
in a manner depicted in Fig. 2.3a. The right-hand expresses the output as made up 
of the sum of the system responses to all the impulse components of the input as 
illustrated in Fig. 2.3e. To summarize, the (zero-state) response y(t) to the input 
f(t) is given by 


12 ie Fl)hlt - r) dr (2.29) 


This is the result we seek. We have obtained the system response y(t) to input 
f(t) in terms of the unit impulse response h(t). Knowing h(t), we can determine 
the response y(t) to any input. Observe once again the all-pervasive nature of the 
system’s characteristic modes. The system response to any input is determined 
by the impulse response, which in turn is made up of characteristic modes of the 
system. 

It is important to keep in mind the assumptions used in deriving Eq. (2.29). 
We assumed a linear, time-invariant (LTI) system. Linearity allowed us to use 
the principle of superposition, and time-invariance made it possible to express the 
system’s response to 6(t — nAr) as h(t — nAr). 


2.4-1 The Convolution Integral 


The zero-state response y(t) obtained in Eq. (2.29) is given by an integral 
that occurs frequently in the physical sciences, engineering, and mathematics. For 


} In deriving this result we have assumed a time-invariant system. If the system is time-varying, 
then the system response to the input 6(¢— Ar) cannot be expressed as h(t — nAr), but instead 
has the form h(t, nAr). Using this form will modify Eq. (2.28) as 


y(t) = J H f(r)h(t, 7) dr (2.28n) 


where h(t, T) is the system response at instant ¢ to a unit impulse input located at 7. 
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this reason this integral is given a special name: the convolution integral. The 
convolution integral of two functions fı(t) and f2(t) is denoted symbolically by 
fi(t) * fo(t) and is defined as i 


fi(t) * folt) = a filr) falt = T) dr (2.30) 


Some important properties of the convolution integral are given below. 


1. The Commutative Property: Convolution operation is commutative; that is, 
fi(t)* fo(t) = fo(t)* fi(t). This property can be proved by a change of variable. 
In Eq. (2.30), if we let z = t — r so that 7 = t — z and dr = —dz, we obtain 


-00 


hahi- [ fala) fae 2) dz 


co 


-f ETET 
= fo(t) * fi(t) (2.31) 


2. The Distributive Property: According to this property: 


Falt) * [fo(t) + fa(t)] = Filt) * falt) + Filt) * falt) (2.32) 
3. The Associative Property: According to this property: 
Falt) * [fo(t) * fa(t)} = [fild) * fa(t)] * falt) (2.33) 


The proofs of (2.32) and (2.33) follow directly from the definition of the con- 
volution integral. They are left as an exercise for the reader. 


4. The Shift Property: If 


filt) * falt) = c(t) 


then 
filt) * fo(t - T) = c(t - T) (2.34) 
filt - T) * fa(t) = c(t = T) (2.34b) 

and 
filt — T1) * folt — T2) = c(t - Ti — T2) (2.34¢) 


Proof: We are given 


f(t) falt) = f a OE, 


Therefore 
f(t) * falt-T)= Í fa(r)falt - T — 7) dr 


=c(t-—T) 


Equation (2.34b) follows from (2.34a) and the commutative property of convo- 
lution; Eq. (2.34c) follows directly from (2.34a) and (2.34b). 


5. Convolution with an Impulse: Convolution of a function f(t) with a unit 
impulse results in the function f(t) itself. By definition of convolution 
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f(t) elt) = T f(r)ólt—r)dr (2.35) 


Because (t — r) is an impulse located at r = t, according to the sampling 
property of the impulse [Eq. (1.24)], the integral in the above equation is the 
value of f(r) at r = t, that is, f(t). Therefore 


F(t) * 6(t) = F(t) (2.36) 

Actually this result has been derived earlier in Eq. (2.28). 
6. The Width Property: If the durations (widths) of fı(t) and fo(t) are Tı and 
T respectively, then the duration (width) of f(t) * fo(t) is Ty + T2 (Fig. 2.4). 
The proof of this property follows readily from the graphical considerations 


discussed later in Sec. 2.4-2. This rule may superficially appear to be violated 
in some special cases discussed later. 


Ji) fa D SiD * RhA) 


a kr 


t —— tt iE" 


Fig. 2.4 Width property of convolution. 


Zero-State Response and Causality 
The (zero-state) response y(t) of an LTIC system is 


y(t) = sent) = [ f(r)a(t — 7) dr (2.37) 


In deriving Eq. (2.37), we assumed the system to be linear and time-invariant. 
There were no other restrictions either on the system or on the input signal f(t). 
In practice, most systems are causal, so that their response cannot begin before the 
input starts. Furthermore, most inputs are also causal, which means they start at 
t=0. 

Causality restrictions on both signals and systems further simplify the limits 
of integration in Eq. (2.37). By definition, the response of a causal system cannot 
begin before its input begins. Consequently, the causal system’s response to a unit 
impulse 6(t) (which is located at t = 0 ) cannot begin before t = 0. Therefore, a 
causal system’s unit impulse response h(t) is a causal signal. 

It is important to remember that the integration in Eq. (2.37) is performed 
with respect to 7 (not t). If the input f(t) is causal, f(r) = 0 for r < 0. Therefore, 
f(r) =O forr < 0, as illustrated in Fig. 2.5a. Similarly, if A(t) is causal, h(t-7) = 0 
for t — 7 < 0; that is, for r > t, as depicted in Fig. 2.5a. Therefore, the product 
f(r)h(t — 7) = 0 everywhere except over the nonshaded interval 0 < r < t shown 
in Fig. 2.5a (assuming t > 0). Observe that if t is negative, f(7)h(t — 7) = 0 for all 
7 as shown in Fig. 2.5b. Therefore, Eq. (2.37) reduces to 
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f(t)=0 hA(t-t) =0 
t20 
f(t) =0 h(t-t)=0 t<0 
Fig. 2.5 Limits of convolution integral. 
t 
y(t) = f(t) * k(t) = ‘i f(r)h(t — 7) dr t>0 (2.38) 
o- 


=0 t<0 


The lower limit of integration in Eq. (2.38) is taken as 07 to avoid the difficulty in 
integration that can arise if f(t) contains an impulse at the origin. In subsequent 
discussion, the lower limit will be shown as 0 with the understanding that it means 
0-. This result shows that if f(t) and h(t) are both causal, the response y(t) is also 
causal. 

Because of the convolution’s commutative property [Eq. (2.31)], we can also 
express Eq. (2.38) as {assuming causal f(t) and h(¢)] 


t 
v= | afe- t20 (2.39) 

0 
As in Eq. (2.38), this result assumes that both the input and the system are causal. 


B® Example 2.4 
For an LTIC system with the unit impulse response h(t) = e~?*u(t), determine the 
response y(t) for the input 


f(t) = eult) (2.40) 


Here both f(t) and A(t) are causal (Fig. 2.6). Hence, we need only to perform the 
convolution’s integration over the range (0, t) [see Eq. (2.38)]. The system response is 
therefore given by 


y(t) = [ f(r)h(t — 7) dr t>0 
10) 
Because f(t) = e™*u(t) and h(t) = e~**u(t) 


f(r) =e7u(r) and h(t- r) =e?" u(t — 7) 


Remember that the integration is performed with respect to r (not t), and the region of 
integration is 0 < 7 < t. In other words, 7 lies between 0 and t. Therefore, if t > 0, then 
T >Oandt—7 > 0, so that u(r) = 1 and u(t — 7) = 1; consequently 


t 
y(t) = f ete 27) dr t>0 
0 
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Fig. 2.6 Convolution of f(t) and h(t) in Example 2.4. 


Because this integration is with respect to 7, we can pull e~* outside the integral, giving 
us 


t 
y(t) = T. edr = a C -1) =e- e7” t>0 (2.41) 
0 


Also, y(t) = 0 when t < 0 [see Eq. (2.38)]. This result, along with Eq. (2.41), yields 
u(t) = (e* —e™™ u(t) (2.42) 
The response is depicted in Fig. 2.6c. W 


A Exercise E2.5 


For an LTIC system with the impulse response h(t) = 6e~*u(t), determine the system re- 
sponse to the input: (a) 2u(t) and (b) 3e—%*u(t). 


Answer: (a) 12(1 —e7*)u(t) (b) 9(e~* ~e~**)u(t) 97 


A Exercise B2.6 
Repeat Exercise E2.5 if the input f(t) = e~*u(t). 
Answer: 6te~*u(t) V7 


The Convolution Table 

The task of convolution is considerably simplified by a ready-made convolution 
table (Table 2.1). This table, which lists several pairs of signals and their resulting 
convolution, can conveniently determine y(t), a system response to an input f(t), 
without performing the tedious job of integration. For instance, we could have 
readily found the convolution in Example 2.4 using pair 4 (with à; = —1 and 
Ag = —2) to be (e~* — e~**)u(t). The following example demonstrates the utility of 
this table. 
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TABLE 2.1: Convolution Table 
Fe 


No f(t) falt) Falt) * falt) = f2(t) * falt) 
Ess a a A a 
1 F(t) êt- T) ft -T) 
1-e** 
2 etu(t) u(t) x u(t) 
3 u(t) u(t) tu(t) 
Mt _ „àt 
4 e™*tu(t) e?tu(t) on = u(t) M#A 
5 eòtu(t) eò™tu(t) teòtu(t) 
6 te™u(t) eòtu(t) stte™ult) 
At nm n=j 
7 tult) edtu(t) ae u(t) > Wino u(t) 
jo 
In! amon 
8 t™u(t) t"u(t) ETETA +n+lu(t) 


edat — ett + (Ar — À2)te™t 


9 teòtu(t) eòatu(t) (A1 — A2)? u(t) 
In! x 
10 t™eòtu(t) teu (t) a Za 7 ym tleòtu(t) 
m j \tgm—j Ait 
~i m!(n + jit" e^ 
Ait à2t (-1)?mi(n tj) te t 
uo me euD D m= FIO — a MO 
j= 
n —k dat 
(—1)¥nl(m + k)! t” e>? 
Ai É A2 +5 kin — Elz — An) RAE u(t) 
k=0 


cos (6 — ¢)e™ ~e- cos (bt +0 ~ 4) 


12 e7% cos (Bt +0)u(t) u(t) Vla ta + 6? 


¢ = tan~*[-6/(a + A) 


(t) 


etu(t) + 2! 


u(-t) 
13 eM tu(t) er2ty(—t) eG ReA2 > Reri 
edt _ erat 
14 eMu(—t) —— eòu(—t) oy ier. 


Pe 
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|_| Example 2.5 


„Find the loop current y(t) of the RLC circuit in Example 2.2 for the input f(t) = 
10e™™ u(t), when all the initial conditions are zero. 


The loop equation for this circuit [see Example 1.11 or Eq. (1.55)] is 


(D? + 3D +2) y(t) = Df(t) 
The impulse response h(t) for this system, as obtained in Example 2.3, is 
h(t) = (2e-** - e™) u(t) 


The input is f(t) = 10e~**u(t), and the response y(t) is 


y(t) = f(t) + h(t) 
= 10e7 u(t) x [2e - e™] u(t) 


Using the distributive property of the convolution [Eq. (2.32)], we obtain 


y(t) = 10e7%*u(t) + 2e7**u(t) — 10e7% u(t) * e*u(t) 
= 20 [e u(t) «e7*u(t)] — 10 [e~*u(t) + e~*u(t)] 


Now the use of Pair 4 in Table 2.1 yields 


y(t) = =o er [e~** - e™™] u(t) — Sra eT fe" - e~*] u(t) 
= —20 (e7* - ert) u(t) +5 (e* - e`’) u(t) 
= (—5e7* + 20277 — 15e7*) u(t) (2.43) 


A Exercise E2.7 
Rework Probs. E2.5 and E2.6 using the convolution table. V7 


A Exercise £2.8 
Using the convolution table, determine 


e~7tu(t) + (1 - e*) u(t) 
Answer: ($ -e7t + je) u(t) y 


A Exercise B2.9 


For an LTIC system with the unit impulse response h(t) = e~?*u(t), determine the zero-state 


response y(t) if the input f(t) = sin 3tu(t). Hint: Use the convolution table Pair 12 with suitable 
values for a 6 @, and A. 


Answer: $ [3e-2t + v13 cos (3t — 146.32°)| u(t) or $ [3e~* — V13 cos (3t + 33.68°)] ut) V 
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Multiple Inputs 

Multiple inputs to LTI systems can be treated by applying the superposition 
principle. Each input is considered separately, with all other inputs assumed to be 
zero. The sum of all these individual system responses constitutes the total system 
output when all the inputs are applied simultaneously. 


2.4-2 Graphical Understanding of Convolution 


To have a proper grasp of convolution operation, we should understand the 
graphical interpretation of convolution. Such a comprehension also helps in evalu- 
ating the convolution integral of more complicated signals. In addition, graphical 
convolution allows us to grasp visually or mentally the convolution integral’s re- 
sult, which can be of great help in sampling, filtering, and many other problems. 
Finally, many signals have no exact mathematical description, so they can be de- 
scribed only graphically. If two such signals are to be convolved, we have no choice 
but to perform their convolution graphically. 

We shall now explain the convolution operation by convolving the signals f(t) 
and g(t), illustrated in Figs. 2.7a and 2.7b respectively. If c(t) is the convolution of 
f(t) with g(t), then 


c(t) = L f(r)g(t — 7) dr (2.44) 


One of the crucial points to remember here is that this integration is performed with 
respect to 7, so that t is just a parameter (like a constant). This consideration is 
especially important when we sketch the graphical representations of the functions 
f(r) and g(t — 7) appearing in the integrand of Eq. (2.44). Both of these functions 
should be sketched as functions of 7, not of t. 

The function f(r) is identical to f(t), with 7 replacing t (Fig. 2.7c). Therefore, 
f(t) and f(r) will have the same graphical representations. Similar remarks apply 
to g(t) and g(r) (Fig. 2.7). 

The function g(t — 7) is not as easy to comprehend. To understand what this 
function looks like, let us start with the function g(r) (Fig. 2.7d). Time-inversion 
of this function (reflection about the vertical axis r = 0) yields g(—T) (Fig. 2.7e). 
Let us denote this function by ¢(r) 


Now ¢(r) shifted by t seconds is (r — t), given by 
o(r — t) = g[-(r — t)] = 9(t-7) 


Therefore, we first time-invert g(r) to obtain g(—r) and then time-shift g(—T) by 
t to obtain g(t — 7). For positive t, the shift is to the right (Fig. 2.7f); for negative 
t, the shift is to the left (Fig. 2.7g). 

The preceding discussion gives us a graphical interpretation of the functions 
f(r) and g(t — 7). The convolution c(t) is the area under the product of these two 
functions. Thus, to compute c(t) at some positive instant t = ti, we first obtain 
g(—7) by inverting g(r) about the vertical axis. Next, we right-shift or delay g(—7) 
by tı to obtain g(t; — 7) (Fig. 2.7f), and then we multiply this function by f(r), 
giving us the product f(r)g(ti — 7) (Fig. 2.7f). The area Ay under this product 
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g(t) 


g(-t) 1 


-1 0 2 t — 


® 


(g) 


(h) 


@ 


Fig. 2.7 Graphical explanation of the convolution operation. 
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is c(t,), the value of c(t) at t = tı. We can therefore plot c(tı) = Ai on a curve 
describing c(t), as shown in Fig. 2.7i. Observe that the area under the product 
f(r)g(—7) in Fig. 2.7e is (0), the value of the convolution for t = 0 (at the origin). 

A similar procedure is followed in computing the value of c(t) at t = t2, where 
tg is negative (Fig. 2.7g). In this case, the function g(—r) is shifted by a negative 
amount (that is, left-shifted) to obtain g(t2—7). Multiplication of this function with 
f(r) yields the product f(r)g(t2 — 7). The area under this product is c(t2) = A2, 
giving us another point on the curve c(t) at t = t2 (Figure 2.7i). This procedure can 
be repeated for all values of t, from —oo to oo. The result will be a curve describing 
c(t) for all time t. Note that when t < —3, f (r)and g(t — 7) do not overlap (see 
Fig. 2.7h); therefore, c(t) = 0 for t < —3. 


Summary of the Graphical Procedure 
The procedure for graphical convolution can be summarized as follows: 


1. Keep the function f(r) fixed. 

2. Visualize the function g(r) as a rigid wire frame, and rotate (or invert) this 
frame about the vertical axis (r = 0) to obtain g(—r). 

3. Shift the inverted frame along the r axis by to seconds. The shifted frame now 
represents g(to — T). 

4, The area under the product of f(r) and g(to — 7) (the shifted frame) is c(to), 
the value of the convolution at t = to. 

5. Repeat this procedure, shifting the frame by different values (positive and 
negative) to obtain c(t) for all values of t. 


Convolution: its bark is worse than its bite! 


The graphical procedure discussed here appears very complicated and discour- 
aging at first reading. Indeed, some people claim that convolution has driven many 
electrical engineering undergraduates to contemplate theology either for salvation 
or as an alternative career ( IEEE Spectrum, March 1991, p.60). Actually, the bark 
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of convolution is worse than its bite! In graphical convolution, we need to deter- 
mine the area under the product f(r)g(t — 7) for all values of t from —co to oo. 
However, a mathematical description of f(7)g(t — 7) is generally valid over a range 
of t. Therefore, repeating the procedure for every value of t amounts to repeating 
it only a few times for different ranges of t. 

We can also use the commutative property of convolution to our advantage 
by computing f(t) * g(t) or g(t) * f(t), whichever is simpler. As a rule of thumb, 
convolution computations are simplified if we choose to invert the simpler of the 
two functions. For example, if the mathematical description of g(t) is simpler than 
that of f(t), then f(t) * g(t) will be easier to compute than g(t) » f(t). In contrast, 
if the mathematical description of f(t) is simpler, the reverse will be true. 

We shall demonstrate graphical convolution with the following examples. Let 
us start by reworking Example 2.4 using this graphical method. 


@ Example 2.6 

Determine graphically y(t) = f(t) * h(t) for f(t) = e~*u(t) and h(t) = e~**u(2). 

Figures 2.8a and 2.8b show f(t) and h(t) respectively, and Fig. 2.8c shows f(r) and 
h(—r) as functions of 7. The function A(t — 7) is now obtained by shifting h(—r) by t. Ift 
is positive, the shift is to the right (delay); if t is negative, the shift is to the left (advance). 
Figure 2.8d shows that for negative t, h(t — r) [obtained by left-shifting h(—7)] does not 
overlap f(r), and the product f(r)h(t — 7) =0, so that 

y(t) =0 t<0 


Figure 2.8e shows the situation for t > 0. Here f(r) and A(t — r) do overlap, but the 
product is nonzero only over the interval 0 < 7 < t (shaded interval). Therefore 


y(t) = f f(r)h(t — 7) dr t>0 
0 


All we need to do now is substitute correct expressions for f(r) and h(t—T) in this integral. 
Figures 2.8a and 2.8b clearly indicate that the segments of f(t) and g(t) to be used in this 
convolution (Fig. 2.8e) are described by 


f(t)=e"* and ar(t)=e~** 


Therefore 
f(r) =e and A(t — 7) =e 20-7) 


Consequently 


t 
w= f ene 28-7) dr 
0 


Moreover, y(t) = 0 for t < 0, so that 


y(t) = (e* - e7”) ut) M 
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h(-1) f(t) 3 


y(t) (f) 


0 t — 


Fig. 2.8 Convolution of f(t) and h(t) in Example 2.6. 


@ Example 2.7 

Find c(t) = f(t) » g(t) for the signals depicted in Figs. 2.9a and 2.9b. 

Since f(t) is simpler than g(t), it is easier to evaluate g(t) * f(t) than f(t) * g(t). 
However, we shall intentionally take the more difficult route and evaluate f(t) + g(t) to 
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clarify some of the finer points of convolution. 
Figures 2.9a and 2.9b show f(t) and g(t) respectively. Observe that g(t) is composed 
of two segments. As a result, it can be described as 


2e~* segment A 
g(t) = 2 
—2e segment B 
Therefore 
( { Qe7 (t-7) segment A (2.48) 
git-—T)= 2.45 
~2e2t-7) segment B 


The segment of f(t) that is used in convolution is f(t) = 1, so that f(7) = 1. Figure 2.9c 
shows f(r) and g(—T). 

To compute c(t) for t > 0, we right-shift g(—7) to obtain g(t—T), as illustrated in Fig. 
2.9d. Clearly, g(t — T) overlaps with f(r) over the shaded interval; that is, over the range 
T > 0; Segment A overlaps with f(r) over the interval (0, t), while Segment B overlaps 
with f(r) over (t, oo). Remembering that f(r) = 1, we have 


e(t) = f Ft- 7) ar 
0 


t [es] 
=f 2e7t-7) art | — 267-7) dr 
0 t 


=2(1-e")-1 
=1 -2e t20 


Figure 2.9e shows the situation for t < 0. Here the overlap is over the shaded interval; 
that is, over the range 7 > 0, where only the segment B of g(t) is involved. Therefore 


TE I fat- r)dr 


oo 
= I g{t —T)dr 
o 
[es] 
1 2e?) dr 
0 


2t 


=-e t<0 
Therefore -2t 
W { 1 — 2e t>0 
c(t) = 
=e” t<0 


Figure 2.9f shows a plot of c(t). W 


E Example 2.8 
Find f(t) » g(t) for the functions f(t) and g(t) shown in Figs. 2.10a and 2.10b. 
Here, f(t) has a simpler mathematical description than that of g(t), so it is preferable 
to invert f(t). Hence, we shall determine g(t) * f(t) rather than f(t) + g(t). Thus 


elt) = alt) * F(t) 
é f olr) f(t - 7) dr 


=% 
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Fig. 2.9 Convolution of f(t) and g(t) in Example 2.7. 
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First, we determine the expressions for the segments of f(t) and g(t) used in finding c(t). 
According to Figs. 2.10a and 2.10b, these segments can be expressed as 


y= 1 and t)= 4t 
Therefore fe) att) = § 


f(t-r)=1 and g(t) = ar 


Fig. 2.10c shows g(r) and f(—r), whereas Fig. 2.10d shows g(r) and f(t — 7), which is 
f(-7) shifted by t. Because the edges of f(—7) are at r = —1 and 1, the edges of f(t — 7) 
are at —l +t and 1 +t. The two functions overlap over the interval (0, 1 + t) (shaded 
interval), so that 


1+t 
e(t) = 1 alr) f(t— 1) dr 
0 


-1<t<l (2.46a) 


This situation, depicted in Fig. 2.10d, is valid only for —1 < t < 1. For t > 1 but < 2, 
the situation is as illustrated in Fig. 2.10e. The two functions overlap only over the range 
-1+t to 1+ ¢ (shaded interval). Note that the expressions for g(r) and f(t — 7) do not 
change; only the range of integration changes. Therefore 


= 3t 1<t<2 (2.46b) 


Also note that the expressions in Eqs. (2.46a) and (2.46b) both apply at t = 1, the tran- 
sition point between their respective ranges. We can readily verify that both expressions 
yield a value of 2/3 at t = 1, so that c(1) = 2/3. The continuity of c(t) at transition points 
indicates a high probability of a right answer.{ For t > 2 but < 4 the situation is as shown 
in Fig. 2.10f. The functions g(r) and f(t — 7) overlap over the interval from —1 + t to 3 
(shaded interval), so that 


=-1 (1-2-8) (246c) 


Again, both Eqs. (2.46b) and (2.46c) apply at the transition point t = 2. We can readily 
verify that c(2) = 4/3 when either of these expressions is used. 

For t > 4, f(t — r) has been shifted so far to the right that it no longer overlaps with 
g(r) as depicted in Fig. 2.10g. Consequently 


c(t) =0 t>4 (2.46d) 


We now turn our attention to negative values of t. We have already determined c(t) 
up to t = —1. For t < —1 there is no overlap between the two functions, as illustrated in 
Fig. 2.10h, so that 

5 ? c(t) =0 t<-1 (2.46e) 


Figure 2.10i shows c(t) plotted according to Eqs. (2.46a) through (2.46e). W 
t Even if c(t) is continuous at the transition, the answer could be wrong in the unlikely event of 


two or more errors canceling out their effects. Our discussion assumes that there are no impulses 
in f(t — rT) and g(r) after the transition which were not present before. 
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Fig. 2.10 Convolution of f(t) and g(t) in Example 2.8. 
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Fig. 2.11 Convolution of f(t) and g(t) in Exercise E2.11. 
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Fig. 2.12 Convolution of f(t) and g(t) in Exercise E2.12. 
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Fig. 2.13 Convolution of f(t) and g(t) in Exercise E2.13. 


Width of the Convolved Function 

The widths (durations) of f(t), g(t), and c(t) in Example 2.8 (Fig. 2.10) are 
2, 3, and 5 respectively. Note that the width of c(t) in this case is the sum of the 
widths of f(t) and g(t). This observation is not a coincidence. Using the concept of 
graphical convolution, we can readily see that if f(t) and g(t) have the finite widths 
of Tı and Tz respectively, then the width of c(t) is generally equal to Tı + T2. The 
reason is that the time it takes for a signal of width (duration) Tı to completely 
pass another signal of width (duration) T2 so that they become nonoverlapping is 
Tı + T2. When the two signals become nonoverlapping, the convolution goes to 
zero. However, there are cases where the two signals f(r) and g(t — 7) overlap, yet 
the area under their product vanishes. Such is the case of signals in Fig. P2.4-14 
for r > 2r. In this case the width property is superficially violated.t 
A Exercise E2.10 

Rework Example 2.7 by evaluating g(t) * f(t) V7 
A Exercise E2.11 

Use graphical convolution to show that f(t) + g(t) = g(t) * f(t) = c(t) in Fig. 2.11. YV 
A Exercise E2.12 

Repeat Prob. E2.11 for the functions in Fig. 2.12. V7 
A Exercise E2.13 

Repeat Prob. E2.11 for the functions in Fig. 2.13. VY 


tEven in such cases, the width property may be held valid if we consider that the region where 
the area under the product of two nonoverlapping signals vanishes to become a part of c(t) (where 
oft) hoppens to be zero). Thus, c(t) in this case has an infinite duration, but the value of c(t) = 0 
or t > 2r. 
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© Computer Example C2.4 
Find c(t) = f(t) * g(t) for the signals in Fig. 2.9. 


tl=-10:.01:0;t1=t1’; 
gl=-2*exp(2*t1); 
t2=0:.01:10;t2=t2’; 
g2=2*exp(-t2); 

t=[t1;t2]; g=[g1;g2]; 

f= [zeros(size(g1));ones(size(g2))]; 
c=0.01*conv(f,g); 
t=-20:.01:5;t=t’; 
plot(t,c(1:length(t))) © 


Some Reflections on the Use of Impulse Function 


In the study of signals and systems we often come across signals such as im- 
pulses, which cannot be generated in practice. One wonders why we even consider 
such signals. The answer should be clear from our discussion so far in this chapter. 
Even if the impulse function has no physical existence, we can compute the system 
response h(t) to this phantom input according to the procedure in Sec. 2.3, and 
knowing h(t), we can compute the system response to any arbitrary input. The 
concept of impulse response, therefore, provides an effective intermediary for com- 
puting system response to an arbitrary input. In addition, the impulse response h(t) 
itself provides a great deal of information and insight about the system behavior. 
In Sec. 2.7 we show that the knowledge of impulse response provides much valuable 
information, such as the response time, pulse dispersion, and filtering properties of 
the system. Many other useful insights about the system behavior can be obtained 
by inspection of h(t). 

We have a similar situation in frequency-domain analysis (discussed in later 
chapters) where we use an everlasting exponential (or sinusoid) to determine system 
response. An everlasting exponential (or sinusoid) has no physical existence, but 
it provides another effective intermediary for computing the system response to 
an arbitrary input. Moreover, the system response to everlasting exponential (or 
sinusoid) provides valuable information and insight regarding the system’s behavior. 


2.4-3 A Very Special Function For LT! Systems: The Everlasting 
Exponential e*t 


There is a very special connection of LTI systems with the everlasting expo- 
nential function e**. We now show that the LTI system’s (zero-state) response to 
everlasting exponential input e% is also the same everlasting exponential (within 
a multiplicative constant). Moreover, no other function can make the same claim. 
Such an input for which the system response is also of the same form is called the 
characteristic function (also eigenfunction) of the system. Because a sinusoid is 
a form of exponential, everlasting sinusoid is also a characteristic function of an LTI 
system. Note that we are talking here of an everlasting exponential (or sinusoid), 
which starts at t = —oo. 

If h(t) is the system’s unit impulse response, then system response y(t) to an 
everlasting exponential e®* is given by 
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y(t) = A(t) +e" = f j h(rjet -n dr 


se h(r)e~*" dr 


is integral on the right-hand side is a function of s. Let us denote it by H(s). 
hust, 


CEM y(t) = H(s)e* (2.47) 


Ha J ” alrje™™ dr (2.48) 


Note that H (s) is a constant for a given s. Thus, the input and the output are the 
same (within a multiplicative constant) for the everlasting exponential signal. 

H(s), which is called the transfer function of the system, is a function of 
complex variable s. We can define the transfer function H(s) of an LTIC system 
from Eq. (2.47) as 


output signal 


H(s)= 
(s) input signal 


(2.49) 


Input=everlasting exponential e** 


The transfer function is defined for, and is meaningful to, LTI systems only. It does 
not exist for nonlinear or time-varying systems in general. 

In this discussion we are talking of the everlasting exponential, which starts at 
t = —0o, not the causal exponential e**u(t), which starts at t = 0. 

For a system specified by Eq. (2.1), the transfer function is given by 

P(s 
H(s)= aa (2.50) 

This follows readily by considering an everlasting input f(t) = e°*. According to Eq. 
(2.47), the output is y(t) = H(s)e*. Substitution of this f(t) and y(t) in Eq. (2.1) 
yields H(s)[Q(D)e*] = P(D)e%. Moreover, D'e*t = d'e*/dt" = s"e%*. Hence, 
P(D)e*t = P(s)e** and Q(D)e* = Q(s)e*. Consequently, H(s) = P(s)/Q(s). 
A Exercise E2.14 

Show that the transfer function of an ideal integrator is H(s) = 1/s and that of an ideal 
differentiator is H(s) = s. Find the answer in two ways: using Eq. (2.49) and Eq. (2.50). V 


2.4-4 Total Response 


The total response of a linear system can be expressed as the sum of its zero- 
input and zero-state components: 


n 
Total Response = Z cet + f(t) *h(t) 
rr er 
x s zero-state component 


zero-input component 


[oe] 


{This result is valid only for the values of s for which the f ee h(r)e—87 dr exists (or converges). 
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Fig. 2.14 Total response and its components. 


For repeated roots, the zero-input component should be appropriately modified. 

For the series RLC circuit in Example 2.2 with the input f(t) = 10e~**u(t) 
and the initial conditions y(07) = 0, vo(07) = 5, we determined the zero-input 
component in Example 2.2 (Eq. (2.15)}|. We found the zero-state component in 
Example 2.5 Using the results in Examples 2.2 and 2.5, we obtain 


Total current = (—be~t + 5e~*) + (—5e™* + 2007" — 15e7%) t > 0 (2.51) 
a a 
zero-input current zero-state current 


Figure 2.14a shows the zero-input, the zero-state, and the total response. 


Natural and Forced Response 

For the RLC circuit in Example 2.2, the characteristic modes were found to 
be e-* and et. As we expected, the zero-input response is composed exclusively 
of characteristic modes. Note, however, that even the zero-state response [Eq. 
(2.51a)] contains characteristic mode terms. This observation is generally true of 
LTI systems. We can now lump together all the characteristic mode terms in the 
total response, giving us a component known as the natural response y,(t). The 
remainder, consisting entirely of noncharacteristic mode terms, is known as the 
forced response y¢(t). The total response of the RLC circuit in Example 2.2 can 
be expressed in terms of natural and forced components by regrouping the terms in 
Eq. (2.51a) as 


Total current = (-10e~* +25e7%) + (~15e~**) t20  (2.51b) 
N —— ee 
natural response yn(t) forced response y¢(t) 


Figure 2.14b shows the natural, forced, and total response. 


2.5 Classical Solution of Differential Equations 


In the classical method we solve differential equation to find the natural and 
forced components rather than the zero-input and zero-state components of the 


140 2 Time-Domain Analysis of Continuous-Time Systems 


response. Although this method is relatively simple compared to the method dis- 
cussed so far, as we shall see, it also has several glaring drawbacks. 

As Sec. 2.4-4 shows, when all of the characteristic mode terms of the total sys- 
tem response are lumped together, they form the system’s natural response y,,(t) 
(also known as the homogeneous solution or complementary solution). The 
remaining portion of the response consists entirely of noncharacteristic mode terms 
and is called the system’s forced response yg(t) (also known as the particular 
solution). Equation (2.51b) shows these two components for the loop current in 
the RLC circuit of Fig. 2.1a. 


The total system response is y(t) = yn(t) + yg(t). Since y(t) must satisfy the 
system equation [Eq. (2.1)], 


Q(D) lyn(t) + vo(t)] = P(D) f(t) 


or 
Q(D)yn(t) + Q(D)yg(t) = P(D) F(t) 


But yn(t) is composed entirely of characteristic modes. Therefore 


Q(D)yn(t) =0 
so that 


Q(D)yg(t) = P(D) f(t) (2.52) 


The natural response, being a linear combination of the system’s characteristic 
modes, has the same form as that of the zero-input response; only its arbitrary 
constants are different. These constants are determined from auxiliary conditions, as 
explained later. We shall now discuss a method of determining the forced response. 


2.5-1 Forced Response: The Method of Undetermined Coefficients 


It is a relatively simple task to determine yg(t), the forced response of an LTIC 
system, when the input f(t) is such that it yields only a finite number of independent 
derivatives. Inputs having the form eft or t" fall into this category. For example, 
et has only one independent derivative; the repeated differentiation of eft yields 
the same form as this input; that is, est. Similarly, the repeated differentiation of 
t” yields only r independent derivatives. The forced response to such an input can 
be expressed as a linear combination of the input and its independent derivatives. 
Consider, for example, the input at?+bt-+c. The successive derivatives of this input 
are 2at +b and 2a. In this case, the input has only two independent derivatives. 
Therefore, the forced response can be assumed to be a linear combination of f(t) 
and its two derivatives. The suitable form for yg(t) in this case is, therefore 


yo(t) = Bot? + Bit + Bo 


The undetermined coefficients 89, 61, and z are determined by substituting this 
expression for yg(t) in Eq. (2.52) 


Q(D)yg(t) = P(D)f(t) 


and then equating coefficients of similar terms on both sides of the resulting expres- 
sion. 
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TABLE 2.2 
Input f(t) Forced Response 

a 

Lo et CAM =1,2,---, 2) pest 

2. est C= Ài Btes* 

3. k B 

4 cos (wt + 8) B cos (wt + o) 

5. (th tart +-+aittao)eS  (Brt" + Brat”) +: + Bit 

+Bo)es* 


Note: By definition, yg(t) cannot have any characteristic mode end If 
any term appearing in the right-hand column for the forced response is cai 
characteristic mode of the system, the correct form of the forced response must i 
modified to t'yg(t), where i is the smallest possible integer that can be used pa > 
can prevent t'yg(t) from having a characteristic mode term. For example, z T e 
input is eS*, the forced response (right-hand column) has the form Be i "a i a 
happens to be a characteristic mode of the system, the correct form o t e ar - 
response is test (see Pair 2). If teft also happens to 5 2 characteristic mode 
the system, the correct form of the forced response is Bt*eS’, and so on. 


a 


Although this method can be used only for inputs with a finite number of 
derivatives, this class of inputs includes a wide variety of the most commonly = 
countered signals in practice. Table 2.2 shows a variety of such inputs and X je 
form of the forced response corresponding to each input. We shall demonstrate this 
procedure with an example. 


E Example 2.9 
Solve the differential equation 


(D? +3D + 2) y(t) = Df(t) 

if the input 
f(t) =t?7+5t4+3 
and the initial conditions are y(0+) = 2 and g(0*) =3. 
The characteristic polynomial of the system is 

A? 43A42 = (A41) +2) 
Therefore, the characteristic modes are e~t and e™%. The natural response is then a linear 
combination of these modes, so that 

yn(t) = Kye7* + Kre~** t>0 

Here the arbitrary constants Ki and K2 must be determined from the system’s initial 
conditions. 
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The forced response to the input t? + 5t + 3, according to Table 2.2 (Pair 5 with 
¢ = 0), is 
yo(t) = Bat” + Bit + Bo 
Moreover, y(t) satisfies the system equation (Eq. (2.52)]; that is, 


Now (D? + 3D + 2) y(t) = Df (t) (2.53) 


Dyg(t) = < (Bat? + Bit + Bo) = 2Bat + Br 


d? 


D?yo(t) = Sy (Bat? + Bit + Bo) = 262 


and 
d p2 
DIM=4 [t +5t+3] =2t+5 
Substituting these results in Eq. (2.53) yields 


Bg 262 + 3(2Bot + B1) + 2(Bat? + Prt + Bo) = 2t +5 


2Bat? + (281 + 6G2)t + (280 + 361 + 282) = 2t + 5 
Equating coefficients of similar powers on both sides of this expression yields 
262 = 0 
261 + 662 = 2 
280 + 38; + 262 = 5 


Solving these three equations for their unknowns, we obtain Bo = 1, 6: = 1, and G2 = 0. 
Therefore 


ye(t) =t+1 t>0 
The total system response y(t) is the sum of the natural and forced solutions. Therefore 
y(t) = yn(t) + velt) 


= Kiet +K” +t+1 t>0 
so that 


y(t) = -Kie™ — 2K27” +1 
Setting t = 0 and substituting y(0) = 2 and ġ(0) = 3 in these equations, we have 
2=Kı+K2+1 
3=-K,-—2K2+1 


The solution of these two simultaneous equations is Kı = 4 and K2 = —3. Therefore 


y(t) = 4e* — 3e7™ +t 41 t20 W 


Comments on initial Conditions 

In the classical method, the initial conditions are required at t = 0+. The 
reason is that because at t = 07, only the zero-input component exists, and the 
initial conditions at t = 07 can be applied to the zero-input component only. In the 
classical method, the zero-input and zero-state components cannot be separated. 


Consequently, the initial conditions must be applied to the total response, which 
begins at t = OF, 
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A Exercise E2.15 f 
An LTIC system is specified by the equation 


(D? +5D+ 6) y(t) = (D+F) 


The input is f(t) = 6t?. Find (a) the forced response yo(t) (b) the total response y(t) if the 
initial conditions are y(0+) = 28 and ġ(0+) = -2. 


— - zidy ti 
Answers: (a) yg(t) = 2 + $t- 3g (b) y(t) = 5e7* — 3e st + (t +4t u). v 


The Exponential input e°¢ 

The exponential signal is the most important signal in the study of LTI systems. 
Interestingly, the forced response for an exponential input signal turns out to be 
very simple. From Table 2.2 we see that the forced response for the input est has 
the form pest. We now show that 6 = Q(¢)/P(¢).t To determine the constant ĝ, 
we substitute yg(t) = Best in the system equation (Eq. (2.52)] to obtain 


Q(D) {6e%'] = P(D)e** (2.54) 
Now observe that 

Det = — (eS*) = e$t 

Dest = S (eS*) = Çel 


Consequently 
(De = Qe and P(D)e** = P()e* 
Therefore, Eq. (2.52) becomes 
BQ (Cet = P(Ce 


and és 
P= 30) 
Thus, for the input f(t) = eStu(t), the forced response is given by 
yo(t)= H(dje* = t > 0 (2.55) 
where pie 
a EM (2.56) 
#O= G0) 


This is an interesting and significant result. It states that for an exponential in- 
put eft the forced response yg(t) is the same exponential multiplied by H (¢) = 
P(¢)/Q(¢). The total system response y(t) to an exponential input est is then 
given by 


y(t) = So Ker" + H(gje* (2.57) 
j=1 


ie 
{ This result is valid only if ¢ is not a characteristic root of the system. 


144 2 Time-Domain Analysis of Continuous-Time Systems 
where the arbitrary constants K1, Ko, ..., Kn are determined from auxiliary con- 
ditions. 


Recall that the exponential signal includes a large variety of signals, such as a 
constant (¢ = 0), a sinusoid (¢ = +jw), and an exponentially growing or decaying 
sinusoid (¢ = o + jw). Let us consider the forced response for some of these cases. 


The Constant Input f(t) =C 


Because C = Ce", the constant input is a special case of the exponential input 
Cest with ¢ = 0. The forced response to this input is then given by 


yelt) =CH(¢)et with ¢=0 
= CH(0) (2.58) 
The Exponential Input e7“* 


Here ¢ = jw and 
velt) = H(jw)e™* (2.59) 


The Sinusoidal Input f(t) = cos wot 


We know that the forced response for the input e*)”¢ is H(+jw)e*#**. Since 
cos wt = (ef”t + et) /2, the forced response to cos wt is 


val) = [Guo jude 


Because the two terms on the right-hand side are conjugates, 


yg(t) = Re [H(jw)e?™*] 
But 


H (jw) = |H (jw) e244») 
so that 


volt) = Re {|H(jw)leter“H Gun} 
= |H(jw)| cos [wt + ZH (jw)| (2.60) 
This result can be generalized for the input f(t) = cos (wt+6). The forced response 
in this case is 
velt) = |H (jw)| cos [wt +8 + ZH (jw)| (2.61) 
E Example 2.10 
Solve the differential equation 
(D? +3D + 2) y(t) = Df(t) 
if the initial conditions are y(0*) = 2 and y(0*) = 3 and the input is 
(a) 10e™™ (b) 5 (ec) e7” (d) 10 cos (3¢ + 30°). 
According to Example 2.9, the natural response for this case is 


yn(t) = Kie™ + Kre” 
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For this case 
-~PO__¢ ana 
HO = 90 = FFI 


(a) For input f(t) = 10e~**, ¢ = —3, and 


-3 -3t -3t 
= -3)e 7% = ot Se a Ae 0 
y(t) = 10H(—-3)e t=10 C3 F38) A e 15e t> 


The total solution (the sum of the forced and the natural response) is 


-3t 


y(t) = Kie ™ + Kre** — 15e t>0 


and -2t —3t 
y(t) = —Kie™ — 2K27” + 45e t>0 


The initial conditions are y(0*+) = 2 and ġ(0*) = 3. Setting ¢ = 0 in the above equations 
and then substituting the initial conditions yields 


Ki, +K2-15=2 and — K,-2K2+45=3 
Solution of these equations yields Kı = —8 and K2 = 25. Therefore 
y(t) = -8e-* + 25e"** — 15e7™  t>0 
(b) For input f(t) = 5 = 5e%, ¢ = 0, and 
ye(t)=5H(0)=0 t>0 
The complete solution is K1e™* + K2e7%. Using the initial conditions, we determine Kı 
and K2 as in part (a). 


(c) Here ¢ = —2, which is also a characteristic root of the system. Hence, (see Pair 
2, Table 2.2, or the comment at the bottom of the table) 


volt) = Bte“™* 
To find £, we substitute yg(t) in the system equation to obtain 


(D? + 3D + 2) ya(t) = Df (t) 


or 
(D? +3D + 2) [Bte] = De“ 
But 
D [Bte] = B(1 — 2t)e™™ 
D? [pte~**] = 48(t - 1)e"* 
De~** = —2e~* 
Consequently 
B(4t -4+3 — 6t + 2t)e 7” = —2e7” 

or 


ape = -267% 
Therefore, 8 = 2 so that 
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yalt) = 2te™* 


The complete solution is Ki1e~* + K2e~** + 2te~**, Using the initial conditions, we deter- 
mine Kı and K2 as in part (a). 


(d) For the input f(t) = 10cos (3t + 30°), the forced response [see Eq. (2.61)} is 


yo(t) = 10] H(j3)| cos [3t + 30° + ZH (43)] 


where 
3) — 203) 33 j3 27 — j21 
H(j3) = — SO E J afl Jet —j37.9° 
QG3) ~ G3)?+ 303) 42 ~ ~7499 ~ i = 0-268e 
Therefore 
|H (43)| = 0.263, 4H (j3) = —37.9° 
and 


Ye (t) = 10(0.263) cos (3t + 30° — 37.9°) = 2.63 cos (3t — 7.9°) 
The complete solution is Kie~* + K2e~** +.2.63 cos (3t—7.9°). Using the initial conditions, 


we determine Kı and Ko asin part (a). W 


E Example 2.11 


Using the classical method, find the loop current y(t) in the RLC circuit of Fig. 2.1, 


Example 2.2 if the input voltage f(t) = 10e~** and the initial conditions are y(0-) =0 
and vc (07) = 5. 


The zero-input and zero-state responses for this problem are found in Examples 2.2 
and 2.5, respectively. The natural and forced responses appear in Eq. 2.51b. Here we shall 
solve this problem by the classical method, which requires the initial conditions at t = Ot. 
These conditions, already found in Eq. (2.16), are 

y0T)=0 and yoty=5 
The loop equation for this system [see Example 2.2 or Eq. (1.55)] is 
(D? + 3D + 2) y(t) = Df(t) 


The characteristic polynomial is A? + 3A +2 = (A+ 1)(A + 2). Therefore, the natural 
response is 


yn(t) = Kie™’ + Kz” 
The forced response, already found in Example 2.10 (a), is 


yo(t) = —15e7” 
The total response is 


y(t) = Kie™* + Kee~** — 15e% 
Differentiation of this equation yields 
y(t) = —Kye~* — 2Koe~** + 45e7** 
Setting t = 07 and substituting y(0+) = 0, y(0*) = 5 in these equations yields 


0=K,+ K2-15 Ki =- 10 
= 


5 =— Kı ~ 2K2+ 45 K2 =25 
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Therefore 
y(t) = —10e7* + 25e7” — 15e7** 


which agrees with the solution found previously in Eq. 2.51b. a 


© Computer Example C2.5 
Solve the differential equation 


(D? + 3D + 2)y(t) = F(t) 
for the input f(t) = 5¢+ 3. 
f£='5*t+3'; 
mpa(’f’,f) 
yt=dsolve(’D2y+3*Dy+2*y=f’,’y(0)=2’,’Dy(0)=3’,’t’) 
yt = -9/4+5/2*t-19/4*exp(-24t)+9¥exp(-t) ©) 


Assessment of the Classical Method 


The development in this section shows that the classical method is relatively 
simple compared to the method of finding the response as a sum of the zero-input 
and zero-state components. Unfortunately, the classical method has a serious draw- 
back because it yields the total response, which cannot be separated into compo- 
nents arising from the internal conditions and the external input. In the study of 
systems it is important to be able to express the system response to an input f (t) as 
an explicit function of f(t). This is not possible in the classical method. Moreover, 
the classical method is restricted to a certain class of inputs; it cannot be applied 
to any input. Another minor problem is that because the classical method yields 
total response, the auxiliary conditions must be on the total response which exists 
only for t > Ot. In practice we are most likely to know the conditions at t = 07 
(before the input is applied). Therefore, we need to derive a new set of auxiliary 
conditions at t = 0+ from the known conditions at t = 07. 

If we must solve a particular linear differential equation or find a response of 
a particular LTI system, the classical method may be the best. In the theoretical 
study of linear systems, however, the classical method is practically useless. 


2.6 System Stability 


Because of the great variety of possible system behaviors, there are several 
definitions of stability in the literature. Here we shall consider a definition that is 
suitable for causal, linear, time-invariant (LTI) systems. 

In order to understand system stability intuitively, let us examine the stability 
concept as applied to a right circular cone. Such a cone can be made to stand 
forever on its circular base, on its apex, or on its side. For this reason these three 
states of the cone are said to be equilibrium states. Qualitatively, however, the 
three states show very different behavior. If this cone, standing on its circular base, 
were to be disturbed slightly, it would eventually return to its original equilibrium 
state if left to itself. In this case, the cone is said to be in stable equilibrium. 
In contrast, if the cone stands on its apex, then the slightest disturbance will cause 
the cone to move farther and farther away from its equilibrium state. The cone in 
this case is said to be in an unstable equilibrium. The cone lying on its side, if 
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disturbed, will neither go back to the original state nor continue to move farther 
away from the original state. The cone in this case is said to be in a neutral 
equilibrium. 

Let us apply these observations to systems in general. If, in the absence of an 
external input, a system remains in a particular state (or condition) indefinitely, 
then that state is said to be an equilibrium state of the system. For an LTI 
system this equilibrium state is the zero state, in which all initial conditions are 
zero. Now suppose an LTI system is in equilibrium (zero state) and we change this 
state by creating some nonzero initial conditions. By analogy with the cone, if the 
system is stable it should eventually return to zero state. In other words, when left 
to itself, the system’s output due to the nonzero initial conditions should approach 
0 as t — oo. But the system output generated by initial conditions (zero-input 
response) is made up of its characteristic modes. For this reason we define stability 
as follows: a system is (asymptotically) stable if, and only if, all its characteristic 
modes — 0 as t — oo. If any of the modes grows without bound as t — oo, the 
system is unstable. There is also a borderline situation in which the zero-input 
response remains bounded (approaches neither zero nor infinity), approaching a 
constant or oscillating with a constant amplitude as t > oo. For this borderline 
situation, the system is said to be marginally stable or just stable. 

If an LTIC system has n distinct characteristic roots \1, A2, +--+) An, the zero- 
input response is given by 


volt) = jeje (2.62) 
j=l 
We have shown elsewhere [see Eq. (B.14)| 


At 0 Re <0 
oo Re A> 0 


lim e 
t—+00 


(2.63) 
It is helpful to study system stability in terms of the location of the system’s charac- 
teristic roots in the complex plane. Let us first assume that the system has distinct 
roots only. If a characteristic root À is located in the left half of the complex plane 
(LHP), its real part is negative (Re A < 0). Similarly, if a root A is located in the 
tight half of the complex plane (RHP), its real part is positive (Re \ > 0). Along 
the imaginary axis, the real part is zero (Re \ = 0). These regions are delineated in 
Fig. 2.15. Equation (2.63) clearly shows that the characteristic modes correspond- 
ing to roots in LHP vanish as t — oo, while the modes corresponding to roots in 
RHP grow without bound as t — oo. However, the modes corresponding to simple 
(unrepeated) roots on the imaginary axis are of the form et; these are bounded 
(neither vanish nor grow without limit) as t — oo. 

From this discussion it follows that a system is asymptotically stable if, and 
only if, all of its characteristic roots lie in the left half of the complex plane. If any 
of the roots—even one—lies in RHP, the system is unstable. If none of the roots lie 
in RHP, but if some unrepeated (simple) roots lie on the imaginary axis, then the 
system is marginally stable (Fig. 2.15). 

So far we have assumed all of the system’s n roots to be distinct. The modes 
corresponding to a root À repeated r times are e**, tet, t?e%#,... 47-12%. But as 
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Re <0 


Real > 


stable 


marginally stable — 
ReA=0 


Fig. 2.15 Characteristic roots location and system stability. 


t — 00, teò% — 0, if ReA < 0 (A in LHP). Therefore, repeated roots in LHP 
do not cause instability. But when the repeated roots are on the imaginary axis 
(A = jw), the corresponding modes t*ei¥t approach infinity as t + oo. Therefore, 
repeated roots on the imaginary axis cause instability. Figure 2.16 shows character- 
istic modes corresponding to characteristic roots at various location in the complex 
plane. Observe the central role played by the characteristic roots or characteristic 
modes in determining the system’s stability. 


To summarize: 


1. An LTIC system is asymptotically stable if, and only if, all the characteristic 
roots are in the LHP. The roots may be simple (unrepeated) or repeated. 


2. An LTIC system is unstable if, and only if, either one or both of the following 
conditions exist: (i) at least one root is in the RHP, (ii) there are repeated 
roots on the imaginary axis. 


3. An LTIC system is marginally stable if, and only if, there are no roots in the 
RHP, and there are some unrepeated roots on the imaginary axis. 


E Example 2.12 l 
Investigate the stability of LTIC system described by the following equations: 


(a) (D+1)(D?+4D +8) y(t) = (D - 3)f (t) 
(b) (D-1) (D? +4D +8) y(t) = (D +2)f(t) 
(c) (D+2)(D? + 4)y(t) = (D? + D +1) f(t) 
(da) (D+1)(D? +4)}y(t) = (D? + 2D +8) f(t) 
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Characterisic Root Characterisic Root 
ation Zero-Input Response Location Zero-Input Response 


t — 


(g) (h) 


Fig. 2.16 Location of characteristic roots and the corresponding characteristic modes. 


The characteristic polynomials of these systems are 


(a) (A+ 1) (A? +4448) = AFD +2- j2)(À + 2 + 52) 
(b) (A= 1) (A? +4448) = (à = 1)(A +2 — j2)(À + 2 + j2) 
(e) (A+ 2)(A? +4) = (A + 2)(A — j2)(à + 42) 

(a) (A+A? 4.4)? = (A +2) — j2 A + 92)? 
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Consequently, the characteristic roots of the systems above are (see Fig. 2.17): 
(a) -1, -24 2 (b) 1, -2+ j2 (c) —2, 92 (d) -1, #92, +32. 


System (a) is asymptotically stable (all roots in LHP), (b) is unstable (one root in * 
RHP), (c) is marginally stable (unrepeated roots on imaginary axis) and no roots in RHP, 
and (d) is unstable (repeated roots on the imaginary axis). a 


(a) (b) (c) (d) 


Fig. 2.17 Location of characteristic roots for systems in Example 2.12. 


A Exercise £2.16 

For each of the systems specified by the equations below, plot its characteristic roots in the 
complex plane and determine whether it is asymptotically stable, marginally stable, or unstable. 

(a) D(D+2)y(t) = 3f() 

(b) D?(D + 3)y(t) = (D + 5) f(t) 

(c) (D+1)(D + 2)y(t) = (2D + 3)F (2) 

(d) (D? +1)(D? + 9)y(t) = (D? + 2D +4) F(t) 

(e) (D+1)(D?-4D+9) y(t) = (D +7) f(t) 


Answer: (a) marginally stable (b) unstable (c) stable (d) marginally stable (e) unstable. V7 


2.6-1 System Response to Bounded inputs 


From the example of the right circular cone, it appears that when a system is 
in stable equilibrium, application of a small force (input) produces a small response. 
In contrast, when the system is in unstable equilibrium, a small force (input) pro- 
duces an unbounded response. Intuitively we feel that every bounded input should 
produce a bounded response in a stable system, whereas in an unstable system this 
would not be the case. We shall now verify this hunch and show that it is indeed 
true. 

Recall that for an LTIC system 


y(t) = h(t) * f(t) 
= a h(r)f(t-7)dr (2.64) 


Therefore 


POE f ” h(l- 7)ldr 


Moreover, if f(t) is bounded, then |f (t — 7)| < Kı < œ, and 


WOLS K: i. In(r) | dr 
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Because h(t) contains terms of the form et or t*e*s*, h(t) decays exponentially 
with time if Re Aj < 0. Consequently, for an asymptotically stable systemt{ 


is |h(r)| dr < K2 < œ (2.65) 


and 
ly(t)| < KıK2 < œ 


Thus, for an asymptotically stable system, a bounded input always produces a 
bounded output. Moreover, we can show that for an unstable or a marginally 
stable system, the output y(t) is unbounded for some bounded input (see Problem 
2.6-4). These results lead to the formulation of an alternative definition of stability 
known as bounded-input, bounded-output (BIBO) stability: a system is 
BIBO stable if, and only if, a bounded input produces a bounded output. Observe 
that an asymptotically stable system is always BIBO stable.t However, a marginally 
stable system is BIBO unstable. 


Implications of Stability 


All practical signal processing systems must be stable. Unstable systems are 
useless from the viewpoint of signal processing because any set of intended or un- 
intended initial conditions leads to an unbounded response that either destroys the 
system or (more likely) leads it to some saturation conditions that change the na- 
ture of the system. Even if the discernible initial conditions are zero, stray voltages 
or thermal noise signals generated within the system will act as initial conditions. 
Because of exponential growth, a stray signal, no matter how small, will eventually 
cause an unbounded output in an unstable system. 

Marginally stable systems do have one important application in the oscillator, 
which is a system that generates a signal on its own without the application of an 
external input. Consequently, the oscillator output is a zero-input response. If such 
a response is to be a sinusoid of frequency wo, the system should be marginally 
stable with characteristic roots at tjwo. Thus, to design an oscillator of frequency 
wo, we should pick a system with the characteristic polynomial (à — jwo)(A+jwo) = 
A? + wo?. A system described by the differential equation 


(D? + wo”) y(t) = F(t) 
will do the job. 


+ This can be shown as follows. If 4; = ai + jfi, then eùt = e%teISit and |er*| = “it, 
Therefore 


OO oo 1 
I |e" u(r)| a= f e% dr = —— if ReA; =a; <0 
—oo0 0 OH 
and Eq. (2.65) follows. This conclusion is also valid when the integrand is of the form jt*erit u(t). 
$ However, a BIBO stable system is not necessarily asymptotically stable because BIBO stability 
is determined from the system’s impulse response, which is an external description of the system, 
while asymptotic stability is determined from the internal description of the system obtained 
from system equations. In certain systems (e.g., uncontrollable or unobservable systems), the two 
descriptions may not be the same. Remember that the external description describes only that 
part of the system which is coupled to both the input and the output. Hence, a system may be 
internally unstable while appearing stable from the system’s external terminals (BIBO stable)”. 
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Intuition can cut the math jungle instantly! 


2.7 Intuitive Insights into System Behavior 


This section attempts to provide an understanding of what determines system 
behavior. Because of its intuitive nature, the following discussion will be more or 
less qualitative. We shall now show that the most important attributes of a system 
are its characteristic roots or characteristic modes because they determine not only 
the zero-input response but also the entire behavior of the system. 


2.7-1 Dependence of System Behavior on Characteristic Modes 


Recall that the zero-input response of a system consists of the system’s charac- 
teristic modes. For a stable system, these characteristic modes decay exponentially 
and eventually vanish. This behavior may give the impression that these modes 
do not substantially affect system behavior in general and system response in par- 
ticular. This impression is totally wrong! We shall now see that the system’s 
characteristic modes leave their imprint on every aspect of the system behavior. 
We may compare the system’s characteristic modes (or roots) to a seed which even- 
tually dissolves in the ground; however, the plant that springs from it is totally 
determined by the seed. The imprint of the seed exists on every cell of the plant. 

In order to understand this interesting phenomenon, recall that the character- 
istic modes of a system are very special to that system because it can sustain these 
signals without the application of an external input. In other words, the system 
offers a free ride and ready access to these signals. Now imagine what would happen 
if we actually drove the system with an input having the form of a characteristic 
mode! We would expect the system to respond strongly (this is, in fact, the res- 
onance phenomenon discussed later in this section). If the input is not exactly a 
characteristic mode but is close to such a mode, we would still expect the system 
response to be strong. However, if the input is very different from any of the char- 
acteristic modes, we would expect the system to respond poorly. We shall now show 
that these intuitive deductions are indeed true. 
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Although we have devised a measure of similarity of signals (correlation) later 
in Chapter 3, we shall take a simpler approach here. Let us restrict the system’s 
inputs only to exponentials of the form e$t, where Ç is generally a complex number. 
The similarity of two exponential signals est and e* will then be measured by the 
closeness of ¢ and À. If the difference ¢ — À is small, the signals are similar; if¢-A 
is large, the signals are dissimilar. 

Now consider a first-order system with a single characteristic mode eò and 
the input eft. The impulse response of this system is then given by Ae**, where 
the exact value of A is not important for this qualitative discussion. The system 
response y(t) is given by 


y(t) = h(t) * f(t) 
= Ae*u(t) x eStu(t) 


From the convolution table (Table 2.1), we obtain 


A 


uO 


[est — e™] u(t) (2.66) 


Clearly, if the input eft is similar to et, ¢— \ is small, and the system response is 
large. The closer the input f(t) is to the characteristic mode, the stronger is the 
system response. In contrast, if the input is very different from the natural mode, 
¢ —» is large, and the system responds poorly. This is precisely what we set out to 
prove. 

We have proved the above assertion for a single-mode (first-order) system. It 
can be generalized to an nth-order system, which has n characteristic modes. The 
impulse response h(t) of such a system is a linear combination of its n modes. 
Therefore, if f(t) is similar to any one of the modes, the corresponding response 
will be high; if it is similar to none of the modes, the response will be small. Clearly, 
the characteristic modes are very influential in determining system response to a 
given input. 

It would be tempting to conclude on the basis of Eq. (2.66) that if the input 
is identical to the characteristic mode, so that ¢ = A, then the response goes to 
infinity. Remember, however, that if ¢ = A, the numerator on the right-hand side 
of Eq. (2.66) also goes to zero. We shall study this complex behavior (resonance 
phenomenon) later in this section. i 

We shall now show that mere inspection of the impulse response h(t) (which is 
composed of characteristic modes), reveals a great deal about the system behavior. 


2.7-2 Response Time of a System: The System Time Constant 


Like human beings, systems have a certain response time. In other words, when 
an input (stimulus) is applied to a system, a certain amount of time elapses before 
the system fully responds to that input. This time lag or response time is called 
the system time constant. As we shall see, a system’s time constant is equal to 
the width of its impulse response h(t). 

An input 6(t) to a system is instantaneous (zero duration), but its response 
h(t) has a duration Th. Therefore, the system requires a time Th to respond fully to 
this input, and we are justified in viewing Th as the system’s response time or time 
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constant. We arrive at the same conclusion via another argument. The output is 
a convolution of the input with A(t). If an input is a pulse of width Ty, then the 
output pulse width is Ty + Tp, according to the width property of convolution. This 
conclusion shows that the system requires Ta seconds to respond fully to any input. 
The system time constant indicates how fast the system is. A system with a smaller 
time constant is a faster system that responds quickly to an input. A system with 
a relatively large time constant is a sluggish system that cannot respond well to 
rapidly varying signals. 

Strictly speaking, the duration of the impulse response h(t) is oo because the 
characteristic modes approach zero asymptotically as t — oo. However, beyond 
some value of t, h(t) becomes negligible. It is therefore necessary to use some 
suitable measure of the impulse response’s effective width. 


0 t 


Fig. 2.18 Effective duration of an impulse response. 


There is no single satisfactory definition of effective signal duration (or width) 
applicable to every situation. For the situation depicted in Fig. 2.18, a reasonable 
definition of the duration h(t) would be Th, the width of the rectangular pulse 
h(t). This rectangular pulse h(t) has an area identical to that of h(t) and a height 
identical to that of h(t) at some suitable instant t = to. In Fig. 2.18, to is chosen 
as the instant at which A(t) is maximum. According to this definition, 


Tph(to) = 3 h(t) dt 


or 
Th = Fee (2.67) 


Now if a system has a single mode 
h(t) = Ae*fu(t) 


with \ negative and real, then h(t) is maximum at t = 0 with value (0) = A. 
Therefore, according to Eq. (2.67) 


Th = > n Ae% dt = a (2.68) 


sss 


f This definition is satisfactory when h(t) is a single, mostly positive (or mostly negative) pulse 
Such systems are lowpass systems. This definition should not be applied indiscriminately to al 
systems. 
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fo h(t) y(t) 


0 t — 0 T, i 
Fig. 2.19 Rise time of a system. 


Thus, the time constant in this case is simply (the negative of the) reciprocal of the 
system’s characteristic root. For the multimode case, A(t) is a weighted sum of the 
system’s characteristic modes, and Tp is a weighted average of the time constants 
associated with the n modes of the system. 


2.7-3 Time Constant and Rise Time of a System 


The system time constant may also be viewed from a different perspective. 
The unit step response y(t) of a system is the convolution of u(t) with h(t). Let 
the impulse response h(t) be a rectangular pulse of width Th, as shown in Fig. 
2.19. This assumption simplifies the discussion, yet gives satisfactory results for 
qualitative discussion. The result of this convolution is illustrated in Fig. 2.19. 
Note that the output does not rise from zero to a final value instantaneously as the 
input rises; instead, the output takes Th seconds to accomplish this. Hence, the rise 
time T, of the system is equal to the system time constantt 


T, =Th (2.69) 


This result and Fig. 2.19 show clearly that a system generally does not respond to 
an input instantaneously. Instead, it takes time Th for the system to respond fully. 


2.7-4 Time Constant and Filtering 


A larger time constant implies a sluggish system because the system takes a 
longer time to respond fully to an input. Such a system cannot respond effectively 
to rapid variations in the input. In contrast, a smaller time constant indicates that 
a system is capable of responding to rapid variations in the input. Thus, there is a 
direct connection between a system’s time constant and its filtering properties. 

Consider a high-frequency sinusoid that varies rapidly with time. A system 
with a large time constant. will not be able to respond well to this input. There- 
fore, such a system will suppress rapidly varying (high-frequency) sinusoids and 
other high-frequency signals, thereby acting as a lowpass filter (a filter allowing the 
transmission of low-frequency signals only). We shall now show that a system with 
a time constant Th acts as a lowpass filter having a cutoff frequency of Fe = 1/Th 
Hz, so that sinusoids with frequencies below F. Hz are transmitted reasonably well, 
while those with frequencies above F, Hz are suppressed. 

To demonstrate this fact, let us determine the system response to a sinusoidal 
input f(t) by convolving this input with the effective impulse response A(t) in Fig. 
2.20a. Figures 2.20b and 2.20c show the process of convolution of h(t) with the 


Í Because of varying definitions of rise time, the reader may find different results in the literature. 
The qualitative and intuitive nature of this discussion should always be kept in mind. 
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Fig. 2.20 Time constant and filtering. 


sinusoidal inputs of two different frequencies. The sinusoid in Fig. 2.20b has a 
relatively high frequency, while the frequency of the sinusoid in Fig. 2.20c is low. 
Recall that the convolution of f(t) and A(t) is equal to the area under the product 
f(r)h(t — r). This area is shown shaded in Figs. 2.20b and 2.20c for the two cases. 
For the high-frequency sinusoid, it is clear from Fig. 2.20b that the area under 
f(r)k(t — 7) is very small because its positive and negative areas nearly cancel 
each other out. In this case the output y(t) remains periodic but has a rather 
small amplitude. This happens when the period of the sinusoid is much smaller 
than the system time-constant Th. In contrast, for the low-frequency sinusoid, the 
period of the sinusoid is larger than Th, so that the partial cancellation of area 
under f(7)h(t — 7) is less effective. Consequently, the output y(t) is much larger, 
as depicted in Fig. 2.20c. 

Between these two possible extremes in system behavior, a transition point 
occurs when the period of the sinusoid is equal to the system time constant Th. 
The frequency at which this transition occurs is known as the cutoff frequency 
F. of the system. Because Th is the period of cutoff frequency Fe, 


1 


Fe = = 
Th 


(2.70) 
The frequency F. is also known as the bandwidth of the system because the system 
transmits or passes sinusoidal components with frequencies below F. while atten- 
uating components with frequencies above F.. Of course, the transition in system 
behavior is gradual. There is no dramatic change in system behavior at Fe = 1/Tp. 
Moreover, these results are based on an idealized (rectangular pulse) impulse re- 
sponse; in practice these results will vary somewhat, depending on the exact shape 
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of h(t). Remember that the “feel” of general system behavior is more important 
than exact system response for this qualitative discussion. 
Since the system time constant is equal to its rise time, we have 


1 1 
as or Fe = T (2.71a) 
Thus, a system ’s bandwidth is inversely proportional to its rise time. Although Eq. 
(2.7la) was derived for an idealized (rectangular) impulse response, its implications 
are valid for lowpass LTIC systems in general. For a general case, we can show 
that 


T, 


k 
Fe = T (2.71b) 
where the exact value of k depends on the nature of h(t). An experienced engineer 
often can estimate quickly the bandwidth of an unknown system by simply observing 


the system response to a step input on an oscilloscope. 


2.7-5 Time Constant and Pulse Dispersion (Spreading) 


In general, the transmission of a pulse through a system causes pulse disper- 
sion (or spreading). Therefore, the output pulse is generally wider than the input 
pulse. This system behavior can have serious consequences in communication sys- 
tems where information is transmitted by pulse amplitudes. Dispersion (or spread- 
ing) causes interference or overlap with neighboring pulses, thereby distorting pulse 
amplitudes and introducing errors in the received information. 

Earlier we saw that if an input f(t) is a pulse of width Ty, then Ty, the width 
of the output y (t), is 


Ty =Ty+Tp (2.72) 


This result shows that an input pulse spreads out (disperses) as it passes through 
a system. Since Ty is also the system’s time constant or rise time, the amount of 
spread in the pulse is equal to the time constant (or rise time) of the system. 


2.7-6 Time Constant and Rate of Information Transmission 


In pulse communications systems where information is conveyed through pulse 
amplitudes, the rate of information transmission is proportional to the rate of pulse 
transmission. We shall demonstrate that to avoid the destruction of information 
caused by dispersion of pulses during their transmission through the channel (trans- 
mission medium), the rate of information transmission should not exceed the band- 
width of the communications channel. 

Since an input pulse spreads out by Th seconds, the consecutive pulses should 
be spaced T, seconds apart in order to avoid interference between pulses. Thus, the 
rate of pulse transmission should not exceed 1/Th pulses/second. But 1/Th = Fe, 
the channel’s bandwidth, so that we can transmit pulses through a communications 
channel at a rate of F. pulses/second and still avoid significant interference between 
the pulses. The rate of information transmission is therefore proportional to the 
channel’s bandwidth (or to the reciprocal of its time constant).t. 


t Theoretically, a channel of bandwidth Fe can transmit up to 27, pulse amplitudes per second 
correctly. Our derivation here, being very simple and qualitative, yields only half the theoretical 
limit. In practice it is difficult to attain the upper theoretical limit; transmission rates of Fe pulses 
per second are more common. 
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This discussion (Secs. 2.7-2 through 2.7-6) shows that the system time constant 
determines much of a system’s behavior—its filtering characteristics, rise time, pulse 
dispersion, and so on. In turn, the time constant is determined by the system’s 
characteristic roots. Clearly the characteristic roots and their relative amounts in 
the impulse response h(t) determine the behavior of a system. 


2.7-7 The Resonance Phenomenon 


Finally, we come to the fascinating phenomenon of resonance. As we have 
mentioned already several times, this phenomenon is observed when the input signal 
is identical or is very similar to a characteristic mode of the system. For the sake 
of simplicity and clarity, we consider a first-order system which has only a single 
mode, e**. Let the impulse response of this system bet 


h(t) = Ae% (2.73) 
and let the input be 
f(t) = e079 


The system response y(t) is then given by 


y(t) = Ae” x est 


From the convolution table we obtain 


u(t) = Ê [er - 20-94 
€ 


= Ae% (==) (2.74) 


E 


Now, as e — 0, both the numerator and the denominator of the term in the paren- 
theses approach zero. Applying L’Hé6pital’s rule to this term yields 


lim y(t) = Ate™ (2.75) 


Clearly, the response does not go to infinity as « — 0, but it acquires a factor t, 
which approaches oo as t — oo. If \ has a negative real part (so that it lies in LHP), 
eò decays faster than t and y(t) — 0 as t — oo. The resonance phenomenon in 
this case is present, but its manifestation is aborted by the signal’s own exponential 
decay. 

This discussion shows that resonance is a cumulative phenomenon, not instan- 
taneous. It builds up linearly{ with t. When the mode decays exponentially, the 
signal decays at a rate too fast for resonance to counteract the decay; as a result, 
the signal vanishes before resonance has a chance to build it up. However, if the 
mode were to decay at a rate less than 1/t, we should see the resonance phenomenon 
clearly. This specific condition would be possible if Re à > 0. For instance, when 
Re A = 0, so that A lies on the imaginary axis of the complex plane, and therefore 


t For convenience we omit multiplying f(t) and h(t) by u(t). Throughout this discussion, we 
assume that they are causal. 

t If the characteristic root in question repeats r times, resonance effect increases as t7~. However, 
t™~1¢At — 0 as t — 00 for any value of r, provided Re à < 0 (à in LHP). 
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A= jw 
and Eq. (2.75) becomes 
y(t) = Ate" (2.76) 
Here, the response does go to infinity linearly with t. 
For a real system, if à = jw is a root, A* = —jw must also be a root; the 


impulse response is of the form Ae/“* + Ae~J“* = 2Acoswt. The response of 
this system to input A cos wt is 2A cos wt * cos wt. The reader can show that this 
convolution contains a term of the form Atcos wt. The resonance phenomenon is 
clearly visible. The system response to its characteristic mode increases linearly 
with time, eventually reaching oo, as indicated in Fig. 2.21. 


y(t) 


Fig. 2.21 Build up of system response in resonance. 


Recall that when A = jw, the system is marginally stable. As we have in- 
dicated, the full effect of resonance cannot be seen for an asymptotically stable 
system; only in a marginally stable system does the resonance phenomenon boost 
the system’s response to infinity when the system’s input is a characteristic mode. 
But even in an asymptotically stable system, we see a manifestation of resonance if 
its characteristic roots are close to the imaginary axis, so that Re is very small. 
We can show that when the characteristic roots of a system are ø + jwo, then, the 
system response to the input e/“°! or the sinusoid cos wot is very large for small 
o.t The response drops off rapidly as the input signal frequency moves away from 
wo. This frequency-selective behavior can be studied more profitably after an un- 
derstanding of frequency-domain analysis is acquired. For this reason we postpone 
full discussion of this subject until Chapter 7. 


Importance of the Resonance Phenomenon 

The resonance phenomenon is very important because it allows us to design 
frequency-selective systems by choosing their characteristic roots properly. Low- 
pass, bandpass, highpass, and bandstop filters are all examples of frequency selec- 
tive networks. In mechanical systems, the inadvertent presence of resonance can 
cause signals of such tremendous magnitudes that the system may fall apart. A 
musical note (periodic vibrations) of proper frequency can shatter a glass if the 
frequency is matched to the characteristic root of the glass, which acts as a me- 
chanical system. Similarly, a company of soldiers marching in step across a bridge 


{This follows directly from Eq. (2.74) with A = ø + jwo ande=o 
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amounts to applying a periodic force to the bridge. If the frequency of this input 
force happens to be nearer to a characteristic root of the bridge, the bridge may 
respond (vibrate) violently and collapse, even though it would have been strong 
enough to carry many soldiers marching out of step. A case in point is the Tacoma 
Narrow Bridge failure of 1940. This bridge was opened to traffic in July 1940. 
Within four months of opening (on 7 November 1940), it collapsed in a mild gale, 
not because of the wind’s brute force but because the frequency of wind-generated 
vortices, which matched the natural frequency (characteristic roots) of the bridge, 
causing resonance. 

Because of the great damage which may occur, mechanical resonance is gener- 
ally something to be avoided, especially in structures or vibrating mechanisms. If 
an engine with periodic force (such as piston motion) is mounted on a platform, the 
platform with its mass and springs should be designed so that their characteristic 
roots are not close to the engine’s frequency of vibration. Proper design of this 
platform can not only avoid resonance, but also attenuate vibrations if the system 
roots are placed far away from the frequency of vibration. 


2.8 Appendix 2.1: Determining the Impulse Response 


We now derive the unit impulse response of an LTIC system S specified by the 
nth-order differential equation 


Q(D)y(t) = P(D) Ff) (2.77a) 


or 
(D” + an-1D™ 1 +-+-+a1D + ao)y(t) 
= (bn D” + bp-1D" 1 +--+ +b,D + bo) f(t) (2.77b) 
In Sec. 2.3 we showed that the impulse response h(t) is given by 


h(t) = Ao6(t) + characteristic modes (2.78) 


We now show that in the above equation Ao = bn where bn is the coefficient of the 
nth-order term on the right-hand side of Eq. (2.77b). When the input f(t) = 6(t), 
the response y(t) = h(t). Therefore, from Eq. (2.77b), we obtain 


(D” +an-1D"1 +--+ aD + a9)h(t) = (nD + bn_1D"} +--+ + b1D + b9)5(t) 
In this equation we substitute h(t) from Eq. (2.78) and compare the coefficients of 
similar impulsive terms on both sides. The highest order of the derivative of impulse 


on both sides is n, with its coefficient value as Ag on the left-hand side and bn on 
the right-hand side. The two values must be matched. Therefore, Ag = bn and 


h(t) = bnô(t) + characteristic modes (2.79) 


To determine the characteristic mode terms in the above equation, let us consider 
a system So whose input f(t) and the corresponding output z(t) are related by 


Q(D)z(t) = f(t) (2.80) 
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Observe that both the systems S and So have the same characteristic polynomial; 
namely, Q(A), and, consequently, the same characteristic modes. Moreover, So is 
the same as S with P(D) = 1, that is, bn = 0. Therefore, according to Eq. (2.79), 
the impulse response of Sq consists of characteristic mode terms only without an 
impulse at t = 0. Let us denote this impulse response of Sp by yn(t). Observe 
that yn(t) consists of characteristic modes of S, and therefore may be viewed as a 
zero-input response of S. Now yn(t) is the response of So to input 4(¢). Therefore, 
according to Eq. (2.80) 


Q(D)yn(t) = 6(t) (2.81a) 

or 
(D” + an—1D"~} + +++ + aD + a0)yn(t) = 4(E) (2.81b) 

or 
y(t) + any" (6) + +++ + ayh (t) + aoyn(t) = ôt) (2.81c) 


where ys (4) represents the kth derivative of yn(t). The right-hand side contains a 
single impulse term 6(t). This is possible only if yo V(t) has a unit jump disconti- 
nuity at t = 0, so that y(t) = 6(t). Moreover, the lower-order terms can not have 
any jump discontinuity because this would mean the presence of the derivatives of 
(t). Suppose, for instance, y,(t) has a jump discontinuity, then its derivative Yn(t) 
contains an impulse 6(t), and its second derivative #,(t) contains the first derivative 
of the impulse 4(t), and so on. But this is impossible because the right-hand side of 
Eq. (2.81c) consists of only 6(t). For this reason only yr) (t) can have a unit jump 
discontinuity so that yf (t) is 6(t). There can be no jump discontinuities in any 
of the remaining variables because this would give rise to higher-order derivatives 
of 6(t) on the left-hand side. Therefore y,(0) = ys (0) =.= ys?) (0) = 0 (no 
discontinuity at t = 0). Therefore, the n initial conditions on yn(t) are 


y-Y(0) =1 

ym(0) = yE? (0) =- = yg? (0) =0 (2.82) 
This discussion means that yn (t) is the zero-input response of the system S subject 
to initial conditions (2.82). 


We now show that for the same input f(t) to both systems, S and So, their 
respective outputs y(t) and z(t) are related by 


y(t) = P(D)2(t) (2.83) 
To prove this result, we operate on both sides of Eq. (2.80) by P(D) to obtain 


Q(D)P(D)a(t) = P(D) f(t) 


Comparison of this equation with Eq. (2.77a) leads immediately to Eq. (2.83). 

Now if the input f(t) = 6(t), the output of So is yn(t), and the output of 
S, according to Eq. (2.83), is P(D)yn(t). This output is A(t), the unit impulse 
response of S. Note, however, that because it is an impulse response of a causal 
system So, the function yn(t) is causal. To incorporate this fact we must represent 
this function as yn(t)u(t). Now it follows that A(t), the unit impulse response of 
the system S, is given by 


h(t) = P(D)fyn(t)u(t)] (2.84) 
where yn (t) is a linear combination of the characteristic modes of the system subject 
to initial conditions (2.82). 
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The right-hand side of Eq. (2.84) is a linear combination of the derivatives of 
yn(t)u(t). Evaluating these derivatives is clumsy and inconvenient because of the 
presence of u(t). The derivatives will generate an impulse and its derivatives at the 
origin. Fortunately when m < n [Eq. (2.77)], we can avoid this difficulty by using 
the observation in Eq. (2.79), which asserts that at t = 0 (the origin), A(t) = b,4(t). 
Therefore, we need not bother to find A(t) at the origin. This simplification means 
that instead of deriving P(D)[yn(t)u(t)}, we can derive P(D)y,(t) and add to it the 
term 6,,6(t), so that 


A(t) = bnô(t) + P(D)yn(t) t20 
= bnô(t) + [P(D)yn(t)]u(t) (2.85) 


This expression is valid when m < n [the form given in Eq. (2.77b)}. When m > n, 
Eq. (2.84) should be used. 


2.9 Summary 


This chapter discusses time-domain analysis of LTIC systems. The total re- 
sponse of a linear system is a sum of the zero-input response and zero-state response. 
The zero-input response is the system response generated only by the internal con- 
ditions (initial conditions) of the system, assuming that the external input is zero; 
hence the term “zero-input.” The zero-state response is the system response gen- 
erated by the external input, assuming that all initial conditions are zero; that is, 
when the system is in zero state. 

Every system can sustain certain forms of response on its own with no external 
input (zero input). These forms are intrinsic characteristics of the system; that 
is, they do not depend on any external input. For this reason they are called 
characteristic modes of the system. Needless to say, the zero-input response is 
made up of characteristic modes chosen in a suitable combination so as to satisfy 
the initial conditions of the system. For an nth-order system, there are n distinct 
modes. 

The unit impulse function is an idealized mathematical model of a signal that 
cannot be generated in practice. Nevertheless, introduction of such a signal as an 
intermediary is very helpful in analysis of signals and systems. The unit impulse 
response of a system is a combination of the characteristic modes of the systemt{ 
because the impulse 6(t) = 0 for t > 0. Therefore, the system response for t > 0 
must necessarily be a zero-input response, which, as seen earlier, is a combination 
of characteristic modes. 


The zero-state response (response due to external input) of a linear system can 
be obtained by breaking the input into simpler components and then adding the 
responses to all the components. In this chapter we represent an arbitrary input 
f(t) as a sum of narrow rectangular pulses [staircase approximation of f(t)]. In the 
limit as the pulse width — 0, the rectangular pulse components approach impulses. 
Knowing the impulse response of the system, we can find the system response to 
all the impulse components and add them to yield the system response to the input 


{ There is the possibility of an impulse in addition to characteristic modes. 
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f(t). The sum of the responses to the impulse components is in the form of an 
integral, known as the convolution integral. The system response is obtained as the 
convolution of the input f(t) with the system’s impulse response h(t). Therefore, 
the knowledge of the system’s impulse response allows us to determine the system 
response to any arbitrary input. 


LTIC systerms have a very special relationship to the everlasting exponential 
signal e** because the response of an LTIC system to such an input signal is the 
same signal within a multiplicative constant. The response of an LTIC system to 
the everlasting exponential input e% is H(s)e*, where H (s) is the transfer function 
of the system. 


Differential equations of LTIC systems can also be solved by the classical 
method, where the response is obtained as a sum of natural and forced response. 
These are not the same as the zero-input and zero-state components, although they 
satisfy the same equations respectively. Although simple, this method suffers from 
the fact that it is applicable to a restricted class of input signals, and the system 
response cannot be expressed as an explicit function of the input. This limitation 
makes it useless in the theoretical study of systems. 


A linear system is in a zero state if all initial conditions are zero. A system in 
a zero state is incapable of generating any response in the absence of an external 
input. When some initial conditions are applied to a system, then, if the system 
eventually goes to zero state in the absence of any external input, the system is said 
to be asymptotically stable. In contrast, if the system’s response increases without 
bound, it is unstable. If neither the system goes to zero state nor the response 
increases indefinitely, the system is marginally stable. The stability criterion in 
terms of the location of a system’s characteristic roots can be summarized as follows: 


1. An LTIC system is asymptotically stable if, and only if, all the characteristic 
roots are in the LHP. The roots may be repeated or unrepeated. 


2. An LTIC system is unstable if, and only if, either one or both of the following 
conditions exist: (i) at least one root is in the RHP; (ii) there are repeated 
roots on the imaginary axis. 


3. An LTIC system is marginally stable if, and only if, there are no roots in the 
RHP, and there are some unrepeated roots on the imaginary axis. 


According to an alternative definition of stability— bounded-input bounded- 
output (BIBO) stability—a system is stable if every bounded input produces a 
bounded output. Otherwise the system is (BIBO) unstable. Asymptotically stable 
system is always BIBO-stable. The converse is not necessarily true, however. 


Characteristic behavior of a system is extremely important because it deter- 
mines not only the system response to internal conditions (zero-input behavior), 
but also the system response to external inputs (zero-state behavior) and the sys- 
tem stability. The system response to external inputs is determined by the impulse 
response, which itself is made up of characteristic modes. The width of the impulse 
response is called the time constant of the system, which indicates how fast the 
system can respond to an input. The time constant plays an important role in de- 
termining such diverse system behavior as the response time and filtering properties 
of the system, dispersion of pulses, and the rate of pulse transmission through the 
system. 
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Problems 


An LTIC system is specified by the equation 
(D? +5D +6) y(t) = (D + 1)f(t) 


(a) Find the characteristic polynomial, characteristic equation, characteristic roots, 
and characteristic modes of this system. 
(b) Find yo(t), the zero-input component of the response y(t) for t > 0, if the initial 
conditions are yo(0) = 2 and yo(0) = —1. 
Repeat Prob. 2.2-1 if 
(D? + 4D + 4) y(t) = Df(t) 
and yo(0) = 3, go(0) = —4. 
Repeat Prob. 2.2-1 if 
D(D + 1)y(t) = (D + 2)f (t) 


and yo(0) = yo(0) = 1. 
Repeat Prob. 2.2-1 if 
(D? + 9) y(t) = (3D + 2) F(t) 
and yo(0) = 0, yo(0) = 6. 
Repeat Prob. 2.2-1 if 
(D? + 4D + 13) y(t) = 4(D + 2)f(t) 
with yo(0) = 5, yo(0) = 15.98. 
Repeat Prob. 2.2-1 if 
D*(D + 1)y(t) = (D? + 2)F(t) 
with yo(0) = 4, yo(0) =3 and ğo(0) = —-1. 
Repeat Prob. 2.2-1 if 
(D + 1) (D? +5D + 6) y(t) = Df(t) 
with yo(0) = 2, yo(0) = —1 and ğo(0) = 5. 
Find the unit impulse response of a system specified by the equation 
(D? + 4D + 3) y(t) = (D +5) f(t) 
Repeat Prob. 2.3-1 if 
(D? +5D +6) y(t) = (D? +7D +11) f(t) 
Repeat Prob. 2.3-1 for the first-order allpass filter specified by the equation 
(D + 1ylt) = -(D- FO 
Find the unit impulse response of an LTIC system specified by the equation 


(D? +6D +9) y(t) = (2D + 9) f(t) 
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4-1 


4-3 


4-4 
4-5 
4-6 


.4-7 


.4-8 
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H e(t) = f(t) * g(t), then show that Ac = Af Ag, where Aș, Ag, and Ac are the areas 
under f(t), g(t), and c(t), respectively. Verify this area property of convolution in 
Examples 2.6 and 2.8. 


H f(t) * g(t) = c(t), then show that f(at) + g(at) = |4}c(at). This time-scaling 
property of convolution states that if both f(t) and g(t) are time-scaled by a, their 
convolution is also time-scaled by a (and multiplied by |1/a|). 


Show that the convolution of an odd and an even function is an odd function and the 
convolution of two odd or two even functions is an even function. 
Hint: Use time-scaling property of convolution in Problem 2.4-2. 


Using direct integration, find e~**u(t) x e~"*u(t). 
Using direct integration, find u(t) * u(t), e~°tu(t) *e~ u(t), and tu(t) * u(t). 
Using direct integration, find sin t u(t) » u(t) and cos t u(t) » u(t). 


The unit impulse response of an LTIC system is h(t) = e~*u(t). Find this system’s 
(zero-state) response y(t) if the input f(t) is: 


(a) u(t) (b) e~*u(t) (c) e7*u(t) (d) sin 3tu(t). 
Use the convolution table to find your answers. 
Repeat Prob. 2.4-7 if 
h(t) = [2e~* - e7™] u(t) 

and if the input f(t) is: (a) u(t) (b) e~*u(t) (c) e7*u(t). 
Repeat Prob. 2.4-7 if 

, h(t) = (1 — 2t)e~**u(t) 
and if the input f(t) = u(t). 


Repeat Prob. 2.4-7 if h(t) = 4e~*' cos 3t u(t) and if the input f(t) is: (a) u(t) (b) 
e- u(t). 


Repeat Prob. 2.4-7 if 
h(t) = e ‘u(t) 


and if the input f(t) is: (a)e~**u(t) (b)e~?"-u(t) (ec) e7**u(t-—3) (d) the 
gate pulse depicted in Fig. P2.4-11. For (d), sketch y(t). 


Hint: The input in (d) can be expressed as u(t) — u(t — 1). For parts (c) and (d), 


use the shift property (2.34) of convolution. (Alternatively, you may want to invoke 
the system’s time-invariance and superposition properties.) 


f(t) 
1 


0 1 


Fig. P2.4-11 
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fi g(t) 


sint 


f(t) sin t g(t) 


t —— 27 t— 


Fig. P2.4-15 


2.4-12 A first-order allpass filter impulse response is given by 


A(t) = —6(t) + 2e7*u(t) 


(a) Find the zero-state response of this filter for the input etu(—t). 
(b) Sketch the input and the corresponding zero-state response. 


2.4-13 Sketch the functions f(t) = mH and u(t). Now find f(t) * u(t) and sketch the result. 
2.4-14 Figure P2.4-14 shows f(t) and g(t). Find and sketch c(t) = f(t) * g(t). 

2.4-15 Find and sketch c(t) = f(t) * g(t) for the functions depicted in Fig. P2.4-15. 

2.4-16 Find and sketch c(t) = f1(t)* fa(t) for the pairs of functions illustrated in Fig. P2.4-16. 


2.4-17 For an LTIC system, if the (zero-state) response to an input f(t) is y(¢), show that 


the (zero-state) response to the input f(t) is y(t) and that for the input feg f(r) dr 
is Es y(t) dr. 

Hint: Recognize that f(t) = limro +i) — f(t —T)]. Now use linearity and time 
invariance to find the response to f(t). Also, recognize that fie f(r) dr = f(t)*u(t). 


2.4-18 If f(t) * g(t) = c(t), then show that 


F(t) * g(t) = F(t) * g(t) = E(t) 
Extend this result to show that 


F(t) x g(t) = lt”) (2) 


where z‘™ (t) is the mth derivative of x(t), and all the derivatives of f(t) and g(t) in 
this integral exist. 

Hint: Use the first part of the hint in Prob. 2.4-17 and the time-shift property of 
convolution. 


2.4-19 As mentioned in Chapter 1 (Fig. 1.27b), it is possible to express an input in terms of 


its step components, as shown in Fig. P2.4-19. If g(t) is the unit step response of an 
LTIC system, show that the (zero-state) response y(t) of the system to an input f(t) 
can be expressed as 


Fig. P2.4-16 


u(t) = / jirat- 7) dr = F(t) *9(t) 


Hint: From Figure P2.4-19, the shaded step component of the input is given by 
(Af)u(t — nAr) ~ [f(r)Arju(t - nâr). Add the system responses to all such 
components. 


2.4-20 A line charge is located along the z axis with a charge density f(x). Show that the 
electric field E(x) produced by this line charge at a point z is given by 


= 1 
~ Arex? 


E(z) = f(z) * h(z) where h(z) 


Hint: The charge over an interval Ar located at r = nAz is f(nAr)Ar. Also by 
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2.4-21 


2.5-1 


2.5-2 


2.5-3 


2.5-4 


2.5-5 


2.6-1 


f(t) 


t=nat 


Fig. P2.4-19 


Coulomb’s law, the electric field E(r) at a distance r from a charge q is given by 


E(r) = —4 


~ Aner? 


Determine H(s), the transfer function of an ideal time delay of T seconds. Find your 
answer by two methods; using Eq. (2.48) and using Eq. (2.49). 


Using the classical method, solve 
(D? +7D +12) y(t) = (D + 2) f(t) 


if the initial conditions are y(0t) = 0, y(0+) = 1, and if the input f(t) is: 
(a) u(t) (b) eult) (c) e7**u(). 
Using the classical method, solve 


(D? + 6D + 25) y(t) = (D + 3) f(t) 


if the initial conditions are y(0*) = 0, y(0*) = 2, and if the input f(t) = u(t). 
Using the classical method, solve 


(D? + 4D + 4) y(t) = (D+ 1)F(t) 


if the initial conditions are y(0*) = 2, y(0*) = 5, and if the input f(t) is: 
(a) e~*u(t) (b) e7*u(t). 


Using the classical method, solve 
(D? + 2D)y(t) = (D + 1)F(t) 


if the initial conditions are y(0*) = 2, y(0*) = 1, and if the input is f(t) = u(t). 
Repeat Prob. 2.5-1 if the input 


f(t) =e*ult) 


Explain, with reasons, whether the LTIC systems described by the following equations 
are asymptotically stable, marginally stable, or unstable. 

(a)(D? + 8D + 12)y(t) = (D - 1) f(t) 

(b)D(D? + 3D + 2)y(t) = (D + 5) f(t) 

(c)D?(D? + 2)y(t) = F(t) 

(d)(D + 1)(D? — 6D + 5)y(t) = (3D + YF) 
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16-2 Repeat Prob. 2.6-1 if 


2.7-2 


2.7-3 


(a)(D +1)(D? + 2D + 5)?y(t) = f(t) 

(b)(D + 1)(D? + 9)y(t) = (2D + 9) f(t) 

(c)(D + 1)(D? + 9)?y(t) = (2D + 9) F(t) 

(d)(D? + 1)(D? + 4)(D? + 9)y(t) = 3D F(t) 

For a certain LTIC system, the impulse response h(t) = u(t). 

(a) Determine the characteristic root(s) of this system. 

(b) Is this system asymptotically or marginally stable, or is it unstable? 
(c) Is this system BIBO stable? 

(d) What can this system be used for? 


In Sec. 2.6 we demonstrated that for an LTIC system, Condition (2.65) is sufficient 
for BIBO stability. Show that this is also a necessary condition for BIBO stability 
in such systems. In other words, show that if Eq. (2.65) is not satisfied, then there 
exists a bounded input that produces an unbounded output. 


Hint: Assume that a system exists for which A(t) violates Eq. (2.65) and yet produces 
an output that is bounded for every bounded input. Establish contradiction in this 
statement by considering an input f(t) defined by f(tı — r) = 1 when A(r) > 0 and 
f(t1 - 7) = —1 when h(r) < 0, where tı is some fixed instant. 


g(t) 


0 1075 


t — 


Fig. P2.7-1 


Data at a rate of 1 million pulses per second are to be transmitted over a certain 
communications channel. The unit step response g(t) for this channel is shown in 
Fig. P2.7-1. 

(a) Explain if this channel can transmit data at the required rate. 

(b) Can an audio signal consisting of components with frequencies up to 15kHz be 
transmitted over this channel with reasonable fidelity? 


A certain communication channel has a bandwidth of 10 kHz. A pulse of 0.5 ms 
duration is transmitted over this channel. 

(a) Determine the width (duration) of the received pulse. 

(b) Find the maximum rate at which these pulses can be transmitted over this channel 
without interference between the successive pulses. 


A first-order LTIC system has a characteristic root \ = —10*. 

(a) Determine T,, the rise time of its unit step input response. 

(b) Determine the bandwidth of this system. 

(c) Determine the rate at which the information pulses can be transmitted through 
this system. 


Signal Representation | By E 
Fourier Series 


This chapter is important for basic understanding of signal representation and 
signal comparison. In Chapter 2 we expressed an arbitrary input f(t) as a sum of 
its impulse components. The LTI system (zero-state) response to input f(t) was 
obtained by summing the system’s responses to all these components in the form 
of the convolution integral. There are infinite possible ways of expressing an input 
f(t) in terms of other signals. For this reason, the problem of signal representation 
in terms of a set of signals is very important in the study of signals and systems. 
This chapter addresses the issue of representing a signal as a sum of its components. 
The problem is similar to that of representing a vector in terms of its components. 


Signals and Vectors 


There is a perfect analogy between signals and vectors; the analogy is so strong 
that the term ‘analogy’ understates the reality. Signals are not just like vectors. 
Signals are vectors! A vector can be represented as a sum of its components in a 
variety of ways, depending upon the choice of coordinate system. A signal can also 
be represented as a sum of its components in a variety of ways. Let us begin with 
some basic vector concepts and then apply these concepts to signals. 


3.1-1 Component of a Vector 


A vector is specified by its magnitude and its direction. We shall denote all 
vectors by boldface. For example, x is a certain vector with magnitude or length 
|x|. For the two vectors f and x shown in Fig. 3.1, we define their dot (inner or 
scalar) product as 

f- x = |f|įx| cos 6 (3.1) 


where @ is the angle between these vectors. Using this definition we can express |x|, 
the length of a vector x as 
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|x|? =x: x (3.2) 


Let the component of f along x be cx as depicted in Fig. 3.1. Geometrically 
the component of f along x is the projection of f on x, and is obtained by drawing 
a perpendicular from the tip of f on the vector x, as illustrated in Fig. 3.1. What 
is the mathematical significance of a component of a vector along another vector? 
As seen from Fig. 3.1, the vector f can be expressed in terms of vector x as 


Fig. 3.1 Component (projection) of a vector along another vector. 


f=cx+e (3.3) 


However, this is not the only way to express f in terms of x. Figure 3.2 shows two 
of the infinite other possibilities. From Figs. 3.2a and 3.2b, we have 


f=cyx +e] = coX + €2 (3.4) 


In each of these three representations f is represented in terms of x plus another 
vector called the error vector. If we approximate f by cx, 


fcx (3.5) 


the error in the approximation is the vector e = f- cx. Similarly, the errors in 
approximations in Figs. 3.2a and 3.2b are e; and e2. What is unique about the 
approximation in Fig. 3.1 is that the error vector is the smallest. We can now 
define mathematically the component of a vector f along vector x to be cx where c 
is chosen to minimize the length of the error vector e = f — cx. 


: (a) (b) 


cx x cx 

Fig. 3.2 Approximation of a vector in terms of another vector. 
Now, the length of the component of f along x is |f| cos @. But it is also c|x| as seen 
from Fig. 3.1. Therefore 


c|x| = |f] cos 8 
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Multiplying both sides by |x| yields 
clx|? = |fi|x| cos @=f-x 
Therefore 
fx (3.6) 
From Fig. 3.1, it is apparent that when f and x are perpendicular, or orthogonal, 
then f has a zero component along x; consequently, c = 0. Keeping an eye on Eq. 


(3.6), we therefore define f and x to be orthogonal if the inner (scalar or dot) 
product of the two vectors is zero, that is, if 


f-x=0 (3.7) 


3.1-2 Component of a Signal 


The concept of a vector component and orthogonality can be extended to sig- 
nals. Consider the problem of approximating a real signal f(t) in terms of another 
real signal x(t) over an interval [t1, t2]: 


f(t)eex(t)h t1StSte (3.8) 


The error e(t) in this approximation is 


(3.9) 
0 otherwise 


ae tee ee th St<te 


We now select some criterion for the ‘best approximation’. We know that the signal 
energy is one possible measure of a signal size. For best approximation, we need to 
minimize the error signal-that is, minimize its size, which is its energy Ee over the 
interval [t1, t2) given by 


t2 
z= f e? (t) dt 
t 


z f IFG) — ca(t))? at 


Note that the right-hand side is a definite integral with t as the dummy variable. 
Hence, Ee is a function of the parameter c (not t) and Ee is minimum for some 
choice of c. To minimize Ee, a necessary condition is 
dE. 
de 


£ | vo - ca(oa] =0 


T 


=0 (3.10) 


or 


Expanding the squared term inside the integral, we obtain 


= | ‘ Poa - = |2 x f (t)z(t) | + [e ie x*(t) ae] =0 


1 
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From which we obtain 


t2 t2 
—2 |  f(t)x(t) dt + 2c i: z?(t) dt =0 


ty 
and 


t2 
F(t)a(t) dt t 
t 1 f” 


c= p = = | fit)ale) ae «(3.11) 
f a(t) dt eae 
t 


1 


We observe a remarkable similarity between the behavior of vectors and signals, as 
indicated by Eqs. (3.6) and (3.11). It is evident from these two parallel expressions 
that the area under the product of two signals corresponds to the inner (scalar or 
dot) product of two vectors. In fact, the area under the product of f(t) and z(t) is 
called the inner product of f(t) and x(t), and is denoted by (f, x). The energy of 
a signal is the inner product of a signal with itself, and corresponds to the vector 
length square (which is the inner product of the vector with itself). 

To summarize our discussion, if a signal f(t) is approximated by another signal 
a(t) as 


f(t) = ext) 


then the optimum value of c that minimizes the energy of the error signal in this 
approximation is given by Eq. (3.11). 

Taking our clue from vectors, we say that a signal f(t) contains a component 
ca(t), where c is given by Eq. (3.11). Note that in vector terminology, cz(t) is 
the projection of f(t) on x(t). Continuing with the analogy, we say that if the 
component of a signal f(t) of the form z(t) is zero (that is, c = 0), the signals 
f(t) and z(t) are orthogonal over the interval [t1, t2]. Therefore, we define the real 
signals f(t) and x(t) to be orthogonal over the interval [t1, t2} ift 


” Felt) at =0 (3.12) 


ti 
E Example 3.1 
For the square signal f(t) shown in Fig. 3.3 find the component in f(t) of the form 
sin t. In other words, approximate f(t) in terms of sin t 


f(t) x csint O<t<2r 


so that the energy of the error signal is minimum. 
In this case 


2r 
z(t)=sint and E= J sin? (t) dt = 7 
o 


From Eq. (3.11), we find 


1 2r , 1 T » 2r : 4 
c= f()sin tdt = — sin tdt + —sin tdt) = — (3.13) 
T Jo T (Jo x W 


{For complex signals the definition is modified as in Eq. (3.20). 
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Fig. 3.3 Approximation of square signal in terms of a single sinusoid. 


Thus 
f(t) 


represents the best approximation of f(t) by the function sin t, which will minimize the 
error energy. This sinusoidal component of f(t) is shown shaded in Fig. 3.3. By analogy 
with vectors, we say that the square function f(t) depicted in Fig. 3.3 has a component of 
signal sin t and that the magnitude of this component is 4/7. E 


sin t (3.14) 


a) 


A Exercise E3.1 

Show that over an interval (—1 < t < 1), the ‘best’ approximation of the signal f(t) = t in 
terms of the function sin t is 2 sin t. Verify that the error signal e(t) = t — 2 sin t is orthogonal 
to the signal sin ¢ over the interval —r < t < m. Sketch the signals t and 2 sin t over the interval 
-r Ltr. Y 


3.1-3 Orthogonality in Complex Signals 


So far we have restricted ourselves to real functions of t. To generalize the 
results to complex functions of t, consider again the problem of approximating a 
function f(t) by a function x(t) over an interval (tı < t < t2): 


f(t) = cx(t) (3.15) 


where f(t) and z(t) now can be complex functions of t. Recall that the energy Ez 
of the complex signal x(t) over an interval [t1, ta] is 


t2 
B= f lac (t)|? dt 
t 


1 


In this case, both the coefficient c and the error 
e(t) = f(t) — cx(t) (3.16) 


are complex (in general). For the ‘best’ approximation, we choose c so that Ee, the 
energy of the error signal e(t) is minimum. Now, 


t2 
Ee -f |Z (t) — ex(t)|? dt (3.17) 


Recall also that 
jut ul? = (u + v)(u* +v*) = |ul? + Jol? + u*v + uv* (3.18) 


Using this result, we can, after some manipulation, rearrange Eq. (3.17) as 
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2 


ee = | POMOL. 


1 


Ee = f If (©)? at — E f(t)2*(t) af + 


1 


Since the first two terms on the right-hand side are independent of c, it is clear that 
Ee is minimized by choosing c so that the third term on the right-hand side is zero. 
This yields 


=: A f(t)x*(t) dt (3.19) 


In light of the above result, we need to redefine orthogonality for the complex case 
as follows: Two complex functions z1(t) and x2(t) are orthogonal over an interval 
(tı <t < ta) if 


te te 
f 21(t)x3(t) dt =0 or J zi(t)z2(t) dt = 0 (3.20) 
t 


1 ty 


Either equality suffices. This is a general definition of orthogonality, which reduces 
to Eq. (3.12) when the functions are real. 


A Exercise E3.2 

Show that over an interval (0 < t < 27), the ‘best’ approximation of the square signal f(t) in 
Fig. 3.3 in terms of the signal eft is given by $ ejt. Verify that the error signal e(t) = f(t)— xe 
is orthogonal to the signal eft. 7 i 


Energy of the Sum of Orthogonal Signals 


We know that the square of the length of a sum of two orthogonal vectors is 
equal to the sum of the squares of the lengths of the two vectors. Thus, if vectors 
x and y are orthogonal, and if z=x+y, then 


2 2 
|z|? = |x|? + lyl 


We have a similar result for signals. The energy of the sum of two orthogonal signals 
is equal to the sum of the energies of the two signals. Thus, if signals z(t) and y(t) 
are orthogonal over an interval {t1, t2], and if z(t) = x(t) + y(t), then 


E, = Es + Ey (3.21) 


We now prove this result for complex signals of which real signals are a special case. 
From Eq. (3.18) it follows that 


[ tet) +OP = | OPa +f OPa +f ateu" eae EKOO 


ty ti ti ti 


t2 t2 
= I Ja (t)? dt + J ly(t)|at (3.22) 
th th 
The last result follows from the fact that because of orthogonality, the two integrals 
of the products x(t)y*(t) and 2*(t)y(t) are zero [see Eq. (3.20)]. This result can be 
extended to the sum of any number of mutually orthogonal signals. 
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3.2 Signal Comparison: Correlation 


Section 3.1 has prepared the foundation for signal comparison. Here again, we 
can benefit by considering the concept of vector comparison. Two vectors f and x 
are similar if f has a large component along x. In other words, if c in Eq. (3.6) is 
large, the vectors f and x are similar. We could consider c as a quantitative measure 
of similarity between f and x. Such a measure, however, would be defective. The 
degree of similarity between f and x should be independent of the lengths of f and 
x. If we double the length of f, for example, the degree of similarity between f and 
x should not change. From Eq. (3.6), however, we see that doubling f doubles the 
value of c (whereas doubling x halves the value of c). Our measure is clearly faulty. 
Similarity between two vectors is indicated by the angle 8 between the vectors. The 
smaller the 8, the greater the similarity, and vice versa. The degree of similarity can 
therefore be conveniently measured by cos 6. The larger the cos @, the greater is the 
similarity between the two vectors. Thus, a suitable measure would be cn = cos 9, 
which is given by 

f.x 

Cn = cos 8 Fixi (3.23) 
We can readily verify that this measure is independent of the lengths of f and x. 
This similarity measure cn is known as the correlation coefficient. Observe that 


Stee, <1 (3.24) 


Thus, the magnitude of cn is never greater than unity. If the two vectors are aligned, 
the similarity is maximum (cp = 1). Two vectors aligned in opposite directions 
have the maximum dissimilarity (cn = —1). If the two vectors are orthogonal, the 
similarity is zero. 

We use the same argument in defining a similarity index (the correlation coef- 
ficient) for signals. We shall consider the signals over the entire time interval from 
—oo to co. To make c in Eq. (3.11) independent of energies (sizes) of f(t) and z(t), 
we must normalize c by normalizing the two signals to have unit energies. Thus, 
the appropriate similarity index cn analogous to Eq. (3.23) is given by 


(3.25) 


Cn = one | f(t)x(t) dt 


Observe that multiplying either f(t) or z(t) by any constant has no effect on this 
index. It is independent of the size (energies) of f(t) and x(t). Using the Schwarz 
inequality,t we can show that the magnitude of cn is never greater than 1 


-1< cn <1 (3.26) 


{Schwarz inequality states that for two real energy signals f(t) and x(t) 


oo 2 
(/ f(t)z(t) i) < Ey Ez (3.25n) 


with equality if and only if z(t) = K f(t), where K is an arbitrary constant. There is also similar 
inequality for complex signals. 
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The Best Friends, Worst Enemies, and Complete Strangers 


We can readily verify that if f(t) = K z(t), then cn = 1 when K is any positive 
constant, and cn = —1 when K is any negative constant. Also cn = 0 if f(t) and 
z(t) are orthogonal. Thus, the maximum similarity [when f(t) = K z(t) is indicated 
by cn = 1, the maximum dissimilarity [when f(t) = -K z(t)} is indicated by cn = 
—1. When the two signals are orthogonal, the similarity is zero. Qualitatively 
speaking, we may view orthogonal signals as unrelated signals. Note that maximum 
dissimilarity is different from unrelatedness qualitatively. For example, we have the 
best friends (cn = 1), the worst enemies (cn = —1), and complete strangers, who 
do not care whether we exist or not (cn = 0). The enemies are not strangers, but 
in many ways, people who think like us, only in opposite ways. 

We can readily extend this discussion to complex signal comparison. We gen- 
eralize the definition of cn to include complex signals as 


(t)x*(t) dt (3.27) 


Ch 


1 fe 
- JEE, pa 


fat) 


Fig. 3.4 Signals for Example 3.2. 


@ Example 3.2 

Find the correlation coefficient cn between the pulse z(t) and the pulses fi(t), i = 
1, 2, 3, 4, 5, and 6 illustrated in Fig. 3.4. 

We shall compute cn using Eq. (3.25) for each of the 6 cases. Let us first compute 
the energies of all the signals. 


5 5 
r= | awa f dt =5 (3.28) 
0 0 


In the same way we find Ey, = 5, Ey, = 1.25, and Ey, = 5. Also, to determine Ej, and 
Ej, we determine the energy E of e~*‘u(t) over the interval t = 0 to T: 


g 2 S 1 2aT 
—at —2at ass —2a 
e= f (e ) a= | e discs tne ) 


For fa(t), a = 1/5 and T = 5. Therefore Ey, = 2.1617. For f(t), a = 1 and T = oo. 
Therefore Ey, = 0.5. The energy of Fy, is given by 
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5 
Ef, =f sin? Int dt = 2.5 
Q 


Using Eq. (3.25), the correlation coefficients for the six cases are found as 


5 
1) = 
Tare [ as 
5 5 i 
tL | (-1)dt=- 1 “8 dt = 
(3) zæ | 1)dt = -1 (4) aim | e~!° dt = 0.961 


5 5 
5 1 tdt = 0.628 (6 E in 2rtdt=0 E 
© S [ s (8) asa j, T” 


Comments on the results: Because f1(t) = z(t), the two signals have the maximum 
possible similarity and cn = 1. However, the signal f(t) also shows maximum 
possible similarity with cn = 1. The reason is that we have defined cn to measure 
the similarity of the waveshapes; it is independent of the amplitude (strength) of the 
signals compared. The signal f2(t) is identical to z(t) in shape; only the amplitude 
(strength) is different. Hence cn = 1. The signal f3(t), on the other hand, has 
the maximum possible dissimilarity with x(t) because it is equal to —z(t). For 
falt), cn = 0.961, implying a high degree of similarity with z(t). This is reasonable 
because f4(t) is very similar to x(t) over the duration of x(t) (for 0 < t < 5). Just 
by inspection, we notice that the variations or changes in both x(t) and f4(t) are 
at similar rates. Such is not the case with fs(t), where we notice that variations in 
fs(t) are generally at a higher rate than those in z(t). There is still considerable 
similarity; both signals always remain positive, and show no oscillations. Both 
signals have zero or negligible strength beyond t = 5. Thus, fs(t) is similar to 
z(t), but not as similar as f4(t). This is why cn = 0.628 for fs(t). The signal 
fe(t) is orthogonal to z(t), so that cn = 0. This fact appears to indicate that the 
dissimilarity in this case is not as strong as that of f3(t) for which cn = —1. This 
conclusion may seem odd because f3(t) appears more similar to z(t) than does 
fe(t). The dissimilarity between x(t) and f3(t) is of the nature of antipathy (the 
worst enemy); in a way they are very similar, but in opposite ways. On the other 
hand, the dissimilarity of x(t) with f¢(t) stems from the fact that they are almost 
of different species or from different planets; it is of the nature of being strangers 
to each other. Hence its dissimilarity with x(t) rates lower than that with f(t). 


5 
(2) ores | (0.5) dt = 1 


A Exercise E3.3 
Show that cn of signals f(t) and f3(t) in Fig. 3.4 is —1, that of fo(t) and f4(t) is 0.961, and 
that of f3(t) and fe(t) is zero. Y 


3.2-1 Application to Signal Detection 


Correlation between two signals is an extremely important concept which mea- 
sures the degree of similarity (agreement or alignment) between the two signals. 
This concept is widely used for signal processing applications in radar, sonar, digi- 
tal communication, electronic warfare and many others. 

We explain this concept by an example of radar where a signal pulse is trans- 
mitted in order to detect a suspected target. If a target is present, the pulse will be 
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reflected by it. If a target is not present, there will be no reflected pulse, just noise. 
The presence or absence of the reflected pulse confirms the presence or absence of 
a target. The crucial problem in this procedure is to detect the heavily attenuated, 
reflected pulse (of known waveform) buried in the unwanted noise signal. In this sit- 
uation, correlation of the received pulse with the transmitted pulse can be of great 
help. A similar situation exists in digital communication where we are required to 
detect the presence of one of the two known waveforms in the presence of noise. 

We now explain qualitatively how signal detection using correlation technique 
is accomplished. Consider the case of binary communication, where two known 
waveforms are received in a random sequence. Each time we receive a pulse, our 
task is to determine which of the two (known) waveforms is received. To make the 
detection easier, we must make the two pulses as dissimilar as possible. Therefore, 
we should select the pulse that is the negative of the other pulse. This choice gives 
the highest dissimilarity (cn = —1). This scheme is sometimes called the antipodal 
scheme. We can also use orthogonal pulses which result in cn = 0. In practice, both 
these options are used, although antipodal is the best in terms of distinguishability 
between the two pulses. 

Now let us consider the antipodal scheme in which the two pulses are p(t) and 
—p(t). The correlation coefficient cp of these pulses is —1. Assume that there is 
no noise or any other imperfections in the transmission. The receiver consists of a 
correlator which computes the correlation between p(t) and the received pulse. If the 
correlation is 1, we decide that p(t) is received, and if the correlation is —1, we decide 
that —p(t) is received. Because of the maximum possible dissimilarity between the 
two pulses, detection is easier. The situation is almost like that in a fairy tale, where 
everybody lives happily ever after. In practice, however, several imperfections occur. 
There is always an unwanted signal (noise) superimposed on the received pulses. 
Moreover, during transmission, pulses get distorted and dispersed (spread out) in 
time. Consequently, a received pulse is corrupted by overlapping tails from other 
pulses. This changes the shape of received pulses, and the correlation coefficient is 
no more +1, but has a smaller magnitude, thus reducing the distinguishability of 
pulses. We use a threshold detector, which decides that if the correlation is positive 
(cn > 0), the received pulse is p(t), and if the correlation is negative (cn < 0), the 
received pulse is —p(t). 

Suppose, for example, that p(t) has been transmitted. In the ideal case, corre- 
lation of this pulse at the receiver would be 1, the maximum possible. Now because 
of the noise and other imperfections, the correlation is going to be less than 1. In 
some extreme situation, the noise and overlapping from other pulses can make this 
pulse so dissimilar to p(t) that the correlation can be a negative amount. In this 
case, the threshold detector decides that —p(t) has been received, thus causing a 
detection error. In the same way, if —p(t) is transmitted, the channel noise, pulse 
distortion, and the overlapping from other pulses could result in a positive corre- 
lation, causing a detection error. Our task is to make sure that the transmitted 
pulses have sufficient energy to keep the relative damage to the pulse caused by 
noise within a limit and the error probability below acceptable bounds. In the ideal 
case, the margin provided by the correlation cn for distinguishing the two pulses 
is 2 (from 1 to —1 and vice versa). The noise and other imperfections reduce this 
margin. That is why it is important to start with as large a margin as possible. 
For this reason the antipodal scheme has the best performance in terms of guarding 
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Fig. 3.5 Physical explanation of the correlation function. 


against the channel noise and other imperfections. However, as mentioned earlier, 
because of some other reasons, different schemes such as an orthogonal scheme, 
where cn = 0, are also used even when they provide a smaller margin (from 0 to 1 
and vice versa) in distinguishing the pulses. 

Some aspects of pulse dispersion were discussed in Secs. 2.7-5 and 2.7-6. In 
chapter 4, we shall discuss pulse distortion during transmission. Calculation of error 
probability in the presence of noise and other imperfections are beyond the scope 
of this work. For a detailed treatment of this subject, the reader may refer to the 
author’s book on communication systems.+ 


3.2-2 Correlation Functions 


Consider an application of correlation to signal detection in a radar, where 
a signal pulse is transmitted in order to detect a suspected target. If a target is 
present, the pulse will be reflected by it. In contrast, if the target is not present, 
there will be no reflected pulse, just noise. By detecting the presence or absence of 
the reflected pulse we confirm the presence or absence of the target. By measuring 
the time delay between the transmitted and received (reflected) pulse we determine 
the distance of the target. Let the transmitted and the reflected pulses be denoted 
by g(t) and f(t), respectively, as shown in Fig. 3.5. If we were to use Eq. (3.25) 
directly to measure the correlation coefficient cn, we would obtain 


1 co 
Cn = —= t = ; 

: see | Jo(t) at = 0 (3.29) 
Thus, the correlation is zero because the pulses are disjoint (nonoverlapping in 
time). The integral (3.29) will yield zero value even when the pulses are identical 
but with relative time shift. To avoid this difficulty, we compare the received pulse 
f(t) with a delayed pulse g(t) for various values of delay. If for some value of delay 
parameter there is a strong correlation, we not only detect the presence of the pulse 
but we also detect the relative time shift of f(t) with respect to g(t). For this 
reason, instead of using the integral on the right-hand, we use the modified integral 
g(t), the crosscorrelation function of two real signals f(t) and g(t) defined byt 


{For complex signals we define 


v(t) = / f> (T)g(7 — t) dr 
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v= f “ear (3.30) 


Here r is a dummy variable, and the pulse g(7 — t) is the pulse g(r) delayed by 
t seconds with respect to the f(r) pulse. Therefore, ysg(t) is an indication of 
similarity (correlation) of the f pulse with g pulse delayed by t seconds. Thus, 
Wyg(t) measures the similarity of pulses even if they are disjoint. In the case of 
signals in Fig. 3.5, w(t) will show significant correlation around t = T. This 
observation allows us not only to detect the presence of the target, but also to 
calculate its distance. 


Convolution and Correlation 


We now examine the close connection between the convolution and the correla- 
tion of f(t) and g(t) [given by Eq. (3.30)}]. Note that g(r — t) is the g(r) time-shifted 
by t. Thus, #fg(t) is equal to the area under the product of the f pulse and g pulse 
time-shifted by ¢ (without time-inversion). In convolution also we follow the same 
procedure, except that the g pulse is time-inverted before it is shifted by t. This 
observation suggests that ws,(t) is equal to f(t) * g(—t) [the convolution of f(t) 
with time-inverted g(t)}, that is, 


Ysolt) = f(t) * 9(-t) (3.31) 
This can be formally proved as follows. Letting g(—-t) = w(t), 


f(t)*g(-t= feet) =f f(r)w(t — 7) dr = f(r)g(t — t)dr = vy, (t) 


To reiterate, yyg(t) is equal to the area under the product of the f pulse and g 
pulse time-shifted by t (without time-inversion), and is given by the convolution of 
f(t) with g(-t). 


A Exercise E3.4 

Show that wWyg(t), the correlation function of f(t) and g(t) in Fig. 2.11 is given by c(t) in 
Fig. 2.12. 7 l 
A Exercise E3.5 

Show that ~sg(t), the correlation function of f(t) and g(t) in Fig. 2.12 is given by c(t) in 
Fig. 2.11. 7 


Autocorrelation Function 


Correlation of a signal with itself is called the autocorrelation. The autocor- 
relation function Yp(t) of a signal f(t) is defined as 


p= [ T Fr) flr t)ar (3.32) 


In Chapter 4, we shall show that the autocorrelation function provides valuable 
spectral information about the signal. 
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CIX + Cix 


Fig. 3.6 Representation of a vector in three-dimensional space. 


3.3 Signal representation by Orthogonal Signal Set 


In this section we show a way of representing a signal as a sum of orthogonal 
signals. Here again we can benefit from the insight gained from a similar problem in 
vectors. We know that a vector can be represented as a sum of orthogonal vectors, 
which form the coordinate system of a vector space. The problem in signals is 
analogous, and the results for signals are parallel to those for vectors. So, let us 
review the case of vector representation. 


3.3-1 Orthogonal Vector Space 


Let us investigate a three-dimensional Cartesian vector space described by three 
mutually orthogonal vectors x1, X2, and x3, as illustrated in Fig. 3.6. First, we 
shall seek to approximate a three-dimensional vector f in terms of two mutually 
orthogonal vectors xı and x2: 


f ~ c1X1 + c2X2 


The error e in this approximation is 


e = f — (c1X1 + ¢2X2) 
or 


f = c1Xı + c2X2 + € 


As in the earlier geometrical argument, we see from Fig 3.6 that the length of e is 
minimum when e is perpendicular to the x,-x2 plane, and cx, and c2X2 are the 
projections (components) of f on x; and x2, respectively. Therefore, the constants 
cı and c2 are given by formula (3.6). Observe that the error vector is orthogonal to 
both the vectors x; and x. 

Now, let us determine the ‘best’ approximation to f in terms of all three mu- 
tually orthogonal vectors x1, x2, and x3: 


f ~ cy xX, + coX2 + c3X3 (3.33) 
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Figure 3.6 shows that a unique choice of c1, co, and cg exists, for which (3.33) is no 
longer an approximation but an equality 


f = c1X1 + coX2 + €3X3 (3.34) 


In this case, c1X1,c2X2, and c3x3 are the projections (components) of f on x1, X2, 
and x3, respectively; that is, 


ea Seis (3.35a) 
Xi ' Xi 
1 
=— fx i=1,2,3 (3.35b) 
x: 


Note that the error in the approximation is zero when f is approximated in terms 
of three mutually orthogonal vectors: x1,x2, and x3. The reason is that f is a 
three-dimensional vector, and the vectors x1, X2, and x3 represent a complete set 
of orthogonal vectors in three-dimensional space. Completeness here means that 
it is impossible to find another vector x4 in this space, which is orthogonal to all 
the three vectors x1, X2, and x3. Any vector in this space can then be represented 
(with zero error) in terms of these three vectors. Such vectors are known as basis 
vectors. If a set of vectors {x;} is not complete, the error in the approximation 
will generally not be zero. Thus, in the three-dimensional case discussed above, it 
is generally not possible to represent a vector f in terms of only two basis vectors 
without an error. 

The choice of basis vectors is not unique. In fact, a set of basis vectors corre- 
sponds to a particular choice of coordinate system. Thus, a 3-dimensional vector 
f may be represented in many different ways, depending on the coordinate system 
used. 


3.3-2 Orthogonal Signal Space 


We start with real signals first, and then extend the discussion to complex 
signals. We proceed with our signal approximation problem using clues and insights 
developed for vector approximation. As before, we define orthogonality of a real 


signal set xı(t), v(t), ---,2w(t) over interval (ti, t2] as 
ta 0 men 
i Im(t)en(t) dt = (3.36) 
ty n man 


If the energies E, = 1 for all n, then the set is normalized and is called an or- 
thonormal set. An orthogonal set can always be normalized by dividing zn(t) by 
VEn for all n. 3 


Now, consider approximating a signal f(t) over the interval [t;, t2] by a set of 


N real, mutually orthogonal signals z1(t), x2(t), ..., g(t) as 
f(t) = crzi(t) + coze(t) +--+ + enen(t) (3.37a) 
N 
= ` cntn(t) (3.37b) 
n=l 


The error e(t) in the approximation (3.37) 
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N 

elt) = f(t) — > enen(t) (3.38) 
n=1 


We show in Appendix 3A that Ee, the energy of the error signal e(t), is minimized 
if we choose 


t2 


f (t)en(t) dt 
cn = Hy (3.39a) 
f tn (t)dt 
ty 
1 fs? 
= E, ‘ f(t)xn(t) dt n=1,2,...,.N (3.39b) 


For this choice of the coefficients cn, it is shown in Appendix 3A that the error 
signal energy Ee is given by 


t2 N 
Ee= | f*(t)dt- Y en? En (3.40) 
tı n=1 
Observe that the error energy Ee generally decreases as N, the number of terms, 
is increased because the term c?Epķ is nonnegative. Hence, it is possible that the 
error energy — 0 as N — œ. When this happens, the orthogonal signal set is said 
to be complete. In this case, Eq. (3.37b) is no more an approximation but an 
equality 


f(t) = cyei(t) + core(t) + +--+ entn(t) + 
= Cn2n(t) ty <t<te (3.41) 


where the coefficients cn are given by Eq. (3.39). Because the error signal energy 
approaches zero, it follows that the energy of f(t) is now equal to the sum of the 
energies of its orthogonal components c1xj(t), cot2(t), caz3(t), =. 

The series on the right-hand side of Eq. (3.41) is called the generalized 
Fourier series of f(t) with respect to the set {z,(t)}. When the set {r,(t)} 
is such that the error energy Ee — 0 as N — oo for every member of some partic- 
ular class, we say that the set {z,(t)} is complete on [t1, t2] for that class of f(t), 
and the set {z,(t)} is called a set of basis functions or basis signals. Unless 
otherwise mentioned, in future we shall consider only the class of energy signals. 

Thus, when the set {rn(t)} is complete, we have the equality (3.41). One 
subtle point that must be understood clearly is the meaning of equality in Eq. 
(3.41). The equality here is not an equality in the ordinary sense, but in the sense 
that the error energy, that is, the energy of the difference between the two sides of 
Eq. (3.41), approaches zero. If the equality exists in the ordinary sense, the error 
energy is always zero, but the converse is not necessarily true. The error energy can 
approach zero even though e(t), the difference between the two sides, is nonzero at 
some isolated instants. The reason is that even if e(t) is nonzero at such instants, 
the area under e?(t) is still zero; thus the Fourier series on the right-hand side of 
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Eq. (3.41) may differ from f(t) at a finite number of points. In fact, when f(t) has 
a jump discontinuity at t = to, the corresponding Fourier series at to converges to 
the mean of f(to*) and f (to). 

In Eq. (3.41), the energy of the left-hand side is Ey, and the energy of the 
right-hand side is the sum of the energies of all the orthogonal components.} Thus 


t2 
f'E) dt = cy? By +e E2 + 


tı 


fo} 
=) en?En (3.42) 
n=1 


This equation goes under the name of Parseval’s theorem. Recall that the signal 
energy (area under the squared value of a signal) is analogous to the square of the 
length of a vector in the vector-signal analogy. In vector space we know that the 
square of the length of a vector is equal to the sum of the squares of the lengths of 
its orthogonal components. The above equation (3.42) is the statement of this fact 
as it applies to signals. 


Generalization to Complex Signals 


The above results can be generalized to complex signals as follows: A set of 


functions 21(t), x2(t), ..., £y (t) is mutually orthogonal over the interval (t1, t2] if 
t2 0 mEn 

] tm(t)z%(t) dé = (3.43) 
th En m=n 


If this set is complete for a certain class of functions, then a function f(t) in this 
class can be expressed as 


f(t) = ciwi(t) + coae(t) +--+ + cai(t) ++: (3.44) 
where 
1 f? 
cn = A F(t)z7 (t) dt (3.45) 


Equation (3.39) [or Eq. (3.45)] shows one interesting property of the coefficients 
of c1, c2, ..., CN; the optimum value of any coefficient in the approximation (3.37) is 
independent of the number of terms used in the approximation. For example, if we 
have used only one term (N = 1) or two terms (N = 2) or any number of terms, the 
optimum value of the coefficient cı would be the same [as given by Eq. (3.39)]. The 
advantage of this approximation of a signal f (t) by a set of mutually orthogonal sig- 
nals is that we can continue to add terms to the approximation without disturbing 
the previous terms. This property of finality of the values of the coefficients is very 


{Note that the energy of a signal cz(t) is Ez. 
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important from a practical point of view. 


Some Examples of Generalized Fourier Series 


Signals are vectors in every sense. Like a vector, a signal can be represents as 
a sum of its components in a variety of ways. Just as vector coordinate systems are 
formed by mutually orthogonal vectors (rectangular, cylindrical, spherical), we also 
have signal coordinate systems (basis signals) formed by a variety of sets of mutually 
orthogonal signals. There exist a large number of orthogonal signal sets which can 
be used as basis signals for generalized Fourier series. Some well-known signal 
sets are trigonometric (sinusoid) functions, exponential functions, Walsh functions, 
Bessel functions, Legendre polynomials, Laguerre functions, Jacobi polynomials, 
Hermite polynomials, and Chebyshev polynomials. The functions that concern us 
most in this book are the trigonometric and the exponential sets discussed in the 
rest of the chapter. 


A Historical Note: Baron Jean-Baptiste-Joseph Fourier (1768-1830) 


The Fourier series and integral is a most beautiful and fruitful development, 
which serves as an indispensable instrument in the treatment of many problems in 
mathematics, science, and engineering. Maxwell was so taken by the beauty of the 
Fourier series that he called it a great mathematical poem. In electrical engineering, 
it is central to the areas of communication, signal processing and several other fields, 
including antennas, but it was not received enthusiastically by the scientific world 
when it was presented. In fact, Fourier could not get his results published as a 
paper. 

Fourier, a tailor’s son, was orphaned at age 8 and educated at a local military 
college (run by Benedictine monks), where he excelled in mathematics. The Bene- 
dictines prevailed upon the young genius to choose the priesthood as his vocation, 
but the revolution broke out before he could take his vows. Fourier joined the peo- 
ple’s party. But in its early days, the French Revolution, like most revolutions of 
its kind, liquidated a large segment of the intelligentsia, including prominent scien- 
tists such as Lavosier. This persecution caused many intellectuals to leave France 
to save themselves from a rapidly rising tide of barbarism. Fourier, who was an 
early enthusiast of the Revolution, narrowly escaped the guillotine twice. It was 
to the everlasting credit of Napoleon that he stopped the persecution of the intelli- 
gentsia and founded new schools to replenish their ranks. The 26-year old Fourier 
was appointed chair of mathematics at the newly created school École Normale in 
1794. 


{Contrast this situation with the polynomial approximation of f(t). Suppose we wish to approxi- 
mate f(t) by a polynomial in t such that the polynomial is equal to f(t) at two points tı and t2. 
This can be done by choosing a first order polynomial ap + aıt with 


f(t1) =ao+aiti and f(t2)= ao + atz 


Solution of these equations yields the desired values of ag and ai. For a three-point approximation, 
we must choose the polynomial ag + ait + azt? with 


f(ti) = ao + aiti + azti? i= 1,2, and 3 
The approximation improves with larger number of points (higher-order polynomial}, but the 


coefficients ao, a1, a2, ++- do not have the finality property. As we increase the number of terms 
in the polynomial, we need to recalculate the coefficients. 
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Joseph Fourier (left) and Napoleon (right). 


Napoleon was the first modern ruler with a scientific education, and he was one 
of the rare persons who was equally comfortable with soldiers and scientist. The age 
of Napoleon was one of the most fruitful in the history of science. Napoleon liked 
to sign himself as a ‘member of institut de France’ (a fraternity of scientists), and he 
once expressed to Laplace his regret that “force of circumstances has led me so far 
from the career of a scientist.”? Many great figures in science and mathematics, in- 
cluding Fourier and Laplace, were honored and promoted by Napoleon. In 1798, he 
took a group of scientists, artists, and scholars—-Fourier among them—on his Egyp- 
tian expedition, with the promise of an exciting and historic union of adventure and 
research. Fourier proved to be a capable administrator of the newly formed Insti- 
tut d'Egypte, which, incidentally, was responsible for the discovery of the Rosetta 
Stone. The inscription on this stone in two languages and three scripts (hiero- 
glyphic, demotic, and Greek) enabled Thomas Young and Jean-Francois Champol- 
lion, a protege of Fourier, to invent a method of translating hieroglyphic writings 
of ancient Egypt-the only significant result of Napoleon’s Egyptian expedition. 


Back in France in 1801, Fourier briefly served in his former position as pro- 
fessor of mathematics at the Ecole Polytechnique in Paris. In 1802 Napoleon ap- 
pointed him the prefect of Isére (with its headquarters in Grenoble), a position in 
which Fourier served with distinction. Fourier was created Baron of the Empire by 
Napoleon in 1809. Later, when Napoleon was exiled to Elba, his route was to take 
him through Grenoble. Fourier had the route changed to avoid meeting Napoleon, 
which would have displeased Fourier’s new master, the Bourbon King Louis XVIII. 
Within a year, Napoleon escaped from Elba. On his way home, at Grenoble, Fourier 
was brought before him in chains. Napoleon scolded Fourier for his ungrateful be- 
havior but reappointed him the prefect of Rhone at Lyons. Within four months 
Napoleon was defeated at Waterloo, and was exiled to St. Helena, never to return. 
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Fourier once again was in disgrace as a Bonapartist, and had to pawn his effects to 
keep himself alive. But through the intercession of a former student, who was now 
a prefect of Paris, he was appointed director of the statistical bureau of the Seine, 
a position that allowed him ample time for scholarly pursuits. Later, in 1827, he 
was elected to the powerful position of perpetual secretary of the Paris Academy of 
Science, a section of the institute.4 

While serving as the prefect of Grenoble, Fourier carried on his elaborate in- 
vestigation of propagation of heat in solid bodies, which led him to the Fourier 
series and the Fourier integral. On 21 December 1807, he announced these results 
in a prize paper on the theory of heat. Fourier claimed that an arbitrary func- 
tion (continuous or with discontinuities) defined in a finite interval by an arbitrarily 
capricious graph can always be expressed as a sum of sinusoids (Fourier series). The 
judges, who included the great French mathematicians Laplace, Lagrange, Monge, 
and LaCroix admitted the novelty and importance of Fourier’s work, but criticized 
it for lack of mathematical rigor and generality. Lagrange thought it incredible that 
a sum of sines and cosines could add up to anything but an infinitely differentiable 
function. Moreover, one of the properties of an infinitely differentiable function is 
that if we know its behavior over an arbitrarily small interval, we can determine its 
behavior over the entire range (the Taylor-Maclaurin series). Such a function is far 
from an arbitrary or a capriciously drawn graph.® Fourier thought the criticism un- 
justified but was unable to prove his claim because the tools required for operations 
with infinite series were not available at the time. However, posterity has proved 
Fourier to be closer to the truth than his critics. This is the classic conflict between 
pure mathematicians and physicists or engineers, as we shall see again in the life 
of Oliver Heaviside (p. 381). In 1829 Dirichlet proved Fourier’s claim concerning 
capriciously drawn functions with a few restrictions (Dirichlet conditions). 

Although three of the four judges were in favor of publication, this paper was 
rejected because of vehement opposition by Lagrange. Fifteen years later, after 
several attempts and disappointments, Fourier published the results in expanded 
form as a text, Theorie analytique de la chaleur, which is now a classic. 
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Consider a signal set: 


{1, cos wot, cos Qwot, ..., COS nwot, ...; 


sin wot, sin Qwot, ..., sin nwot, ...} (3.46) 


A sinusoid of frequency nwọ is called the nth harmonic of the sinusoid of frequency 
wo when n is an integer. In this set the sinusoid of frequency wo, called the funda- 
mental, serves as an anchor of which all the remaining terms are harmonics. Note 
that the constant term 1 is the Oth harmonic in this set because cos (0 x wot) = 1. 
In Appendix 3B we show that this set is orthogonal over any interval of duration 
To = 2r /wo, which is the period of the fundamental. Specifically, we have shown 
that 


0 nám 
7 COS nwot COS mwot dt = (3.47a) 
To fo m=nF#0 
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0 nám 
J sin nwot sin mwot dt = (3.47b) 
To a n=mF0 


and 


f sin nwot cos mwotdt =0 for all n and m (3.47c) 
To 


The notation Jr means the integral over an interval from t = tı to tı + To for 
any value of tı. These equations show that the set (3.46) is orthogonal over any 
contiguous interval of duration Tọ. This is the trigonometric set, which can 
be shown to be a complete set.^” Therefore, we can express a signal f(t) by a 
trigonometric Fourier series over any interval of duration To seconds as 


f(t) = ao + a1 cos wot + az cos 2wot + ++: 


+ by sin wot + b2 sin 2wot +-+: t1<t<ti+T% (3.48a) 
or 2 
f(t)=ao+ y an COS nwot + bn sin nwot t<t<t +T (3.48b) 
n=1 
where 2 
T 
==> 3.49 
wo = y (3.49) 
Using Eq. (3.39), we can determine the Fourier coefficients ao, an, and bn. Thus 
tı+To 
J f(t) cos nwot dt 
an = trm ~ (3.50) 
J cos? nwot dt 
tı 


The integral in the denominator of Eq. (3.50) as seen from Eq. (3.47a) (with m = n) 
is Ty/2 when n # 0. Moreover, for n = 0, the denominator is To. Hence 


1 tit+To 
a= > f(t) dt (3.51a) 
To Jty 
and 
2 t1+To 
an = F f(t) cos nwot dt n=1,2,3,... (3.51b) 
To Sty 
Arguing the same way, we obtain 
2 tı+To 
bn = zJ f(t)sin nwot dt n=1,2,8,... (3.51c) 
To Jt, 


Compact Trigonometric Fourier Series 


The trigonometric Fourier series in Eq. (3.48) contains sine and cosine terms 
of the same frequency. We can combine the two terms to obtain a single sinusoid 
of the same frequency using the trigonometric identity 


an COS Nwot + bn sin nwot = Cn cos (nwot + On) (3.52) 
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where 
Cn = Van? + bn” (3.53a) 
-1 -bn 
6, = tan (=) (3.53b) 
an 


For consistency, we denote the dc term ag by Co, that is 
Co = a0 (3.53c) 


Using the identity (3.52), the trigonometric Fourier series in Eq. (3.48) can be 
expressed in the compact form of the trigonometric Fourier series as 


oo 
F(t)=Cot Y Cncos(nwot+0n) t StS ti +To (3.54) 
n=l 
where the coefficients Cn and ôn are computed from an and bn using Eqs. (3.53). 
Equation 3.51a shows that ap (or Co) is the average value of f(t) (averaged 
over one period). This value can often be determined by inspection of f(t). 


E Example 3.3 

Find the compact trigonometric Fourier series for the exponential e 
Fig. 3.7a over the shaded interval 0 < t < m. 

Because we are required to represent f(t) by the trigonometric Fourier series over the 
interval 0 < t < x only, To = 7, and the fundamental frequency is 


~*/2 depicted in 


wo = Lb =2 
To 
Therefore 
oO 
f(t) = ao + } an cos Int + bn sin Int O<t<mr 


n=1 


where {from Eq. (3.51a)] 


w= =f e~t/? at = 0.504 
® Jo 


Qn = al e*/* cos 2nt dt = 0.504 (<a) 


1+ 16n? 
and 
ieee | odin 2ntdt = 0.504 (pa) 
ie 1+ 16n? 
Therefore 


oo 
f(t) = 0.504 i +5 rros 2nt + 4nsin ma O<t<r 
n=1 


To find the compact Fourier series, we compute its coefficients using Eq. (3.53) as 


Co = ag = 0.504 


2 
Cn = Wak + 0% = 0.504)/ tone + qty = 0.504 (sex) 


6, = tan * (=) = tan -/(—4n) = — tan™™ 4n (3.55) 


an 
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Fig. 3.7 A periodic signal and its Fourier spectra. 


The values of Cn and On for the dc and the first seven harmonics are computed from 
the above equation and displayed in Table 3.1. Using these numerical values, we can 
express f(t) in the compact trigonometric Fourier series as 


oo 
2 -i 
=0. 0.504 — cos (2nt — tan” 4n O<t<n7 (3.56a) 
f(t) = 0.504 + 2 rra ) 


= 0.504 + 0.244 cos (2t — 75.96°) + 0.125 cos (4t — 82.87°) 
+ 0.084 cos (6t — 85.24°) + 0.063 cos (8t — 86.42°) +-+- 0 < t < 7 (3.56b) 


Remember that the right-hand side represents e™*/? over the interval 0 to 7 only. Outside 
this interval, the two sides need not be equal. 


Table 3.1 


cae 


[om | 0 | 
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Periodicity of the Trigonometric Fourier Series 


We have shown how an arbitrary signal f(t) may be expressed as a trigonomet- 
tic Fourier series over any interval of Ty seconds. In Example 3.3, for instance, we 
represented e—*/2 over the interval from 0 to 1 /2 only. The Fourier series found in 
Eq. (3.56) is equal to e~*/? over this interval alone. Outside this interval the series 
is not necessarily equal to e~*/?. It would be interesting to find out what happens 
to the Fourier series outside this interval. We now show that the trigonometric 
Fourier series is a periodic function of period Tp (the period of the fundamental). 
Let us denote the trigonometric Fourier series on the right-hand side of Eq. (3.54) 
by y(t). Therefore 


y(t) = Co + X Cn cos (nwot +0) for allt 
and n=] 


p(t + To) = Co + X Cr cos [nwo(t + To) + On} 


n=l 


= Co + D Cn cos [(nwot + 2nT) + On] 


n=1 


=Co+ 5 Chn cos (nwot + On) 


n=1 
= (t) for all t (3.57) 


This result shows that the trigonometric Fourier series is a periodic function of 
period To (the period of its fundamental). For instance, y(t), the Fourier series on 
the right-hand side of Eq. (3.56), is a periodic function in which the segment of f (t) 
in Fig. 3.7a over the interval (0 < ¢ < r) repeats periodically every m seconds, as 
illustrated in Fig. 3.7b.t Thus, when we represent a signal f(t) by the trigonometric 
Fourier series over a certain interval of duration Tp, the function f(t) and its Fourier 
series y(t) need be equal only over that interval of Ty seconds. Outside this interval, 
the Fourier series repeats periodically with period Tp. 

Now, if the function f(t) were itself to be periodic with period Tọ, then a 
Fourier series representing f(t) over an interval To will also represent f(t) for all t 
(not just over the interval Tọ). Another interesting fact, as seen in Fig. 1.7, is that a 
periodic signal f(t) can be generated by a periodic repetition of any of its segment 
of duration Ty. Therefore, the trigonometric Fourier series representing a segment 
of f(t) of duration Tp starting at any instant represents f(t) for all t. Therefore, it 
follows that in computing the coefficients ao, an; and bn, we may use any value for 
tı in Eqs. (3.51). In other words, we may perform this integration over any interval 
of To. Thus the Fourier coefficients of a series representing a periodic signal f(t) 
(for all t) can be expressed as 


ag = f(t) dt (3.58a) 
To 


To 


{In reality, the series convergence at the points of discontinuity shows about 9% overshoot (Gibbs 
phenomenon®) as discussed later. 
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2 
an = — | f(t)cos nwot dt n= 1,2) 3).45 (3.58b) 
To To 
and 
2 
bn = => (t) sin nwot dt = 12, Bp 252 (3.58c) 
To J 


where Jn means that the integration is performed over any interval of To seconds. 


The Fourier Spectrum 


The compact trigonometric Fourier series in Eq. (3.54) indicates that a periodic 
signal f(t) can be expressed as a sum of sinusoids of frequencies 0 (de), wo, 2wo, °° 
nwo, ---, whose amplitudes are Co, Ci, C2, -.., Cn, ++, and whose phases are 0, 41, 
62, ++, On, *+*, respectively. We can readily plot amplitude Cn vs. w (amplitude 
spectrum) and @,, vs. w (phase spectrum). These two plots together are the 
frequency spectra of f(t). 

Figures 3.7c and 3.7d show the amplitude and phase spectra for the periodic 
signal y(t) in Fig. 3.7b. These spectra tell us at a glance the frequency composition 
of p(t); that is, the amplitudes and phases of various sinusoidal components of 
y(t). Knowing the frequency spectra, we can reconstruct or synthesize y(t), as 
shown on the right-hand side of Eq. (3.56). Therefore, the frequency spectra in 
Figs. 3.7c and 3.7d provide an alternative description—the frequency-domain 
description of y(t). The time-domain description of y(t) is depicted in Fig. 3.7b. 
A signal, therefore, has a dual identity: the time-domain identity y(t) and the 
frequency-domain identity (Fourier spectra). The two identities complement each 
other; taken together, they provide a better understanding of a signal. 


Series Convergence at Jump Discontinuities 


An interesting aspect of a Fourier series is that whenever there is a jump 
discontinuity in f(t), the series at the point of discontinuity converges to an average 
of the left-hand and right-hand limits of f(t) at the instant of discontinuity.t In 
Fig. 3.7b, for instance, y(t) is discontinuous at t = 0 with g(0+) = 1 and y(07) = 
e77/2 = 0.208. The corresponding Fourier series converges to a value (1+0.208)/2 = 
0.604 at t = 0. This conclusion is easily verified from Eq. 3.56b by setting t = 0. 


Existence of the Fourier Series: Dirichiet Conditions 


There are two basic conditions for the existence of the Fourier series 


1. For the series to exist, the coefficients ap, an, and bn in Eq. (3.51) must be 
finite. From Eqs. (3.51a), (3.51b), and (3.51c), it follows that the existence of these 
coefficients is guaranteed if f(t) is absolutely integrable over one period; that is, 


If(e)| dé < œ (3.59) 
To 


{This behavior of the Fourier series is dictated by its error energy minimization property, discussed 
in Sec. 3.3. 
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This condition is known as the weak Dirichlet condition. If a function f(t) sat- 
isfies the weak Dirichlet condition, the existence of a Fourier series is guaranteed, 
but the series may not converge at every point. For example, if a function f(t) is 
infinite at some point, then obviously the series representing the function will be 
nonconvergent at that point. Similarly, if a function has an infinite number of max- 
ima and minima in one period, then the function contains an appreciable amount 
of components of frequencies approaching infinity. Consequently, the coefficients 
in the series at higher frequencies do not decay rapidly, so that the series will not 
converge rapidly or uniformly. Thus, for a convergent Fourier series, in addition to 
condition (3.59), we require that 


2. The function f(t) have only a finite number of maxima and minima in one 
period, and only a finite number of finite discontinuities in one period. These two 
conditions are known as the strong Dirichlet conditions. We note here that any 
periodic waveform that can be generated in a laboratory satisfies strong Dirichlet 
conditions, and hence possesses a convergent Fourier series. Thus, a physical possi- 
bility of a periodic waveform is a valid and sufficient condition for the existence of 
a convergent series. 


@ Example 3.4 

Find the compact trigonometric Fourier series for the periodic square wave f(t) illus- 
trated in Fig. 3.8a, and sketch its amplitude and phase spectra. 

Here, the period To = 27 and wo = 2r /To = 1. Therefore 


oo 
f(t) = ao + D cos nt + bn sin nt 
n=l 
where+ 


ao = E f(t) dt 
To To 


In the above equation we may integrate f(t) over any interval of duration To = 2x. Figure 
3.8a shows that the best choice for a region of integration is from —m to m. Because 
f(t) = 1 only over (—$, 3) and f(t) = 0 over the remaining segment, 


n/2 

1 1 

ao = x | dt=>5 (3.60a) 
a —x/2 


We could have easily deduced that ao, the average value of f(t), is 3 merely by inspection 
of f(t) in Fig. 3.8a. Also, 


i, (7? 2 
an= f cos nt dt = — sin (F) 
T J r2 nT 2 


0 n even 
= 2% n =1, 5, 9, 13, --- (3.60b) 
2 n =3, 7, 11, 15,--- 


Ee ad 


n/2 
bn = / sin nt dt = 0 (3.60c) 
na {2 
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Fig. 3.8 A square pulse periodic signal and its Fourier spectra. 
Therefore 
) (3.61) 


1, 2 1 1 1 
=-=-+- -= += = o E 
f(t) 2 (cos ¢ 3 cos 3t 5 cos 5t 7 00s 7 + 


Observe that bn = O and all the sine terms are zero. Only the cosine terms appear in the 
trigonometric series. The series is therefore already in the compact form except that the 
amplitudes of alternating harmonics are negative. Now, by definition, amplitudes Cr are 
positive [see Eq. (3.53a)}. The negative sign can be accommodated by a phase of 7 radians 
as seen from the trigonometric identity{ 


—cos g = cos (x — 7) 


Using this fact, we can express the series in (3.61) as 


1 2 1 1 1 iz 1 | 
ae ae [cos £+ 5 cos (3t — r) + Ș cos 5t + 7 cos (Tt T) + g cos 9t + 


This is precisely the Fourier series in the compact trigonometric form, The amplitudes are 


Ore 
0 n even 
Ca= 

2 n odd 
mm 

0 for all n Æ 3,7, 11,15,--- 

bn = 
=r n = 3,7,11,15, 


{Because cos (x +7) = — cos z, we could have chosen the phase or —r. In fact, cos (z + Nm) = 
— cos x for any odd integral value of N. Therefore, the phase can be chosen as +Na where N is 
any convenient odd integer. 
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Using the above values we could plot amplitude and phase spectra. However, to simplify 
our task in this special case, we will allow amplitude Cn to take on negative values so 
that we do not need a phase of —7 to account for the sign. In other words, phases of all 
components are zero, so we can discard the phase spectrum and manage with only the 
amplitude spectrum, as shown in Fig. 3.8b. Observe that this simpler procedure involves 
no loss of information and that the amplitude spectrum in Fig. 3.8b has the complete 
information about the Fourier series in (3.61). Therefore, whenever all sine terms vanish 
(bn = 0), it is convenient to allow Cn to take on negative values. This procedure permits 
the spectral information to be conveyed by a single spectrum—the amplitude spectrum. 
Because Cn can be positive as well as negative, the spectrum is called the amplitude 
spectrum rather than the magnitude spectrum. 


a Example 3.5 

Find the compact trigonometric Fourier series for the triangular periodic signal f(t) 
illustrated in Fig. 3.9a, and sketch the amplitude and phase spectra for f(t). 

In this case the period To = 2. Hence 


ba 2r 7 
o= = = 
and 2 
œ 
f(t) = ao + Yoan cos nat + bn sin nxt 
n=l 
where 


2At lth <4 
f(t) = i z 
2A(1 = t) 2< t< 3 


Here it will be advantageous to choose the interval of integration from -4 to 3 rather 
than 0 to 2. 


A glance at Fig. 3.9a shows that the average value (dc) of f(t) is zero, so that ap = 0. 
Also 


2 pil? 
Qn == f(t) cos nat dt 
2 J-a 


1/2 3/2 
= I 2At cos nrt dt + | 2A(1i — t) cos nat dt 
-1/2 1/2 


The detailed evaluation of the above integrals shows that both have a value of zero. There- 
fore 


an=0 (3.62a) 


1/2 3/2 
bn = f 2Atsin nrt dt +f 2A(1 — t)sin nat dt 
-1/2 1/2 


The detailed evaluation of these integrals yields 


0 n even 
heck aie (=) =/ 4 n=1,5,9,13,--- (3.62b) 


-$f  n=3,7, 11, 15,--- 
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TE) 


(b) 
(c) 
Fig. 3.9 A triangular periodic signal and its Fourier spectra. 
Therefore 
8A f. di. 1s aaka | 3.63 
fi) = ae [sin mt — gan 3nt + z 90 5rt p Tnt + (3.63) 


In order to plot Fourier spectra, the series must be converted into compact trigonometric 
form as in Eq. (3.54). In this case, sine terms are readily converted into cosine terms with 
a suitable phase shift. For example, 


+sin kt = cos (kt ¥ 90°) 


Using this identity, Eq. (3.63) can be expressed as 
8A 1 o 1 o 
f(t) = = feos (xt — 90°) + 908 (3nt + 90°) + z 08 (57t — 90°) 
l e (3.64) 
+ qq 008 (Tat + 90°) + i 


In this series all the even harmonics are missing. The phases of odd harmonics alternate 
from —90° to 90°. Figure 3.9 shows amplitude and phase spectra for f (2). a 


3.4-1 The Effect of Symmetry 


The Fourier series for the periodic signal in Fig. 3.7b (Example 3.3) consists 
of sine and cosine terms, but the series for the signal f(t) in Fig. 3.8a (Example 
3.4) consists of cosine terms only, and the series for the signal f (t) in Fig. 3.9a 
(Example 3.5) consists of sine terms only. This observation is no accident. We can 
show that the Fourier series of any even periodic function f(t) consists of cosine 
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terms only and the series for any odd periodic function f(t) consists of sine terms 
only. Moreover, because of symmetry (even or odd), the information of one period 
of f(t) is implicit in only half the period, as seen in Figs. 3.8a and 3.9a. In these 
cases, knowing the signal over a half period and what kind of symmetry (even or 
odd) is present, we can determine the signal waveform over a complete period. For 
this reason, the Fourier coefficients in these cases can be computed by integrating 


over only half the period rather than a complete period. To prove this result, recall 
that 


1 To /2 

ao = — t)dt (3.65a) 
To -To/2 
2 fT 

an = — f(t) cos nwot dt (3.65b) 
To J~T/2 
2 Tol? 

bn = — f(t) sin nwot dt (3.65c) 
To -To/2 


Recall also that cos nwot is an even function and sin nwot is an odd function of 
t. If f(t) is an even function of t, then f(t) cos nwot is also an even function and 
f(t) sin nwot is an odd function of t (see Sec. 1.5-1). Therefore, use of Eqs. (1.33a) 
and (1.33b) yields 


2 To/2 

ao = > f(t) dt (3.66a) 
To 0 
4 To /2 

an = = f(t) cos nwot dt (3.66b) 
To 0 

bn = 0 (3.66c) 


Similarly, if f(t) is an odd function of t, then f(t) cos nwot is an odd function of t 
and f(t)sin nwot is an even function of t. Therefore 


a9 =an =Q (3.67a) 
4 pTo/2 

bn = => f(t) sin nwot dt (3.67b) 
To Jo 


Observe that, because of symmetry, the integration required to compute the coeffi- 
cients need be performed over only half the period. 

If a periodic signal f(t), shifted by half the period, remains unchanged except 
for a sign—that is, if 


f(t- B) =-s(t) 


the signal is said to have a half-wave symmetry. We can demonstrate that in 
a signal with a half-wave symmetry, all the even-numbered harmonics vanish (see 
Prob. 3.4-7). The signal in Fig. 3.9a is a clear example of such a symmetry. This 
half-wave symmetry is also present in the signal in Fig. 3.8a but in a subtle form. 
The half-wave symmetry becomes obvious, however, when we subtract the de com- 
ponent 0.5 from this signal. Note that this signal has a de component 0.5 and only 
odd harmonics. 
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Fig. 3.10 Periodic signals for Exercise £3.6. 


A Exercise E3.6 

Find the compact trigonometric Fourier series for the periodic signals depicted in Figs. 3.10a 
and 3.10b. Sketch their amplitude and phase spectra. Allow Cn to take on negative values if bn = 0 
so that the phase spectrum can be eliminated. Hint: Use Eqs. (3.66) and (3.67) for symmetry. 
Answers: 


I 


— 4y (cos mt — } cos 2nt + $ cos Smt — zk cos dnt +-+) 


(a) F(t) 


1 1 
= it [cos (mt = m) + $ cos ant + gost- m) +] 


i 


(b) f(t) = 24 [sin mt- } sin 2nt + $ sin 3nt ~ $ sin dnt +---] 


x 
= 24 [cos (nt ~ 90°) + 4 cos (27t + 90°) + 4 cos (3mt — 90°) +-- ‘| v 


3.4-2 Determining the Fundamental Frequency and Period 


We have seen that every periodic signal can be expressed as a sum of sinusoids 
of a fundamental frequency wo and its harmonics. One may ask whether a sum 
of sinusoids of any frequencies represents a periodic signal. If so, how does one 
determine the period? Consider the following three functions: 


filt) =24 7cos (3t +61) + 3cos (ĝt + 62) + 5cos (Zt + 43) 
fo(t) = 2cos (2t + 81) + 5sin (mt + 02) 


f3(t) = 3sin (3v2t +8) +7 cos (6v2t+¢) 


Recall that every frequency in a periodic signal is an integral multiple of the 
fundamental frequency wo. Therefore, the ratio of any two frequencies is of the form 
m/n where m and n are integers. This means that the ratio of any two frequencies 
is a rational number. When the ratio of two frequencies is a rational number, they 
are said to be harmonically related. 

The largest positive number of which all the frequencies are integral multiples 
is the fundamental frequency. The frequencies in the spectrum of f,(t) are 2 2, 
and z (we do not consider dc). The ratios of the successive frequencies are 7 and 
4, respectively. Because both these numbers are rational, all the three frequencies 
in the spectrum are harmonically related and the signal f(t) is periodic. The largest 
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E 
number of which 3, 2, and z are integral multiples is zt Moreover, 3(2) 4 3, 
4(2) = 2, and 7(2) = Z. Therefore the fundamental frequency is 4. The thtee 
frequencies in the spectrum are the third, fourth, and seventh harmonics. Observe 
that the fundamental frequency component is absent in this Fourier series. 

The signal f2(t) is not periodic because the ratio of two frequencies in the 
spectrum is 2/7, which is not a rational number. The signal f3(t) is periodic because 
the ratio of frequencies 3/2 and 6V2 is 1/2, a rational number. The greatest 
common divisor of 3/2 and 6v2 is 3/2. Therefore the fundamental frequency 
wo = 3V2, and the period 


A Exercise E3.7 
Determine whether the signal 


f(t) = cos (3¢ + 30°) + sin ($¢ + 45°) 
is periodic. If it is periodic, find the fundamental frequency and the period. What harmonics are 
present in f(t)? 
Answer: Periodic with wo = % and period To = 157. The fifth and sixth harmonics. Vv 


3.4-3 The Role of Amplitude and Phase Spectra in Wave Shaping 


The trigonometric Fourier series of a signal f(t) shows explicitly the sinusoidal 
components of f(t). We can synthesize f(t) by adding the sinusoids in the spectrum 
of f(t). To synthesize the square-pulse periodic signal f (t) of Fig. 3.8a, we add 
successive harmonics in its spectrum step by step and observe the similarity of the 
resulting signal to f(t). The Fourier series for this function as found in Example 
3.4 is 

dey 2 7 1 3 1 5 1 7 
f(tj= st = (cos = 3 008 t+ z cos t— 7 60s tte) 
We start the synthesis with only the first term in the series (n = 0), a constant 3 
(dc); this is a gross approximation of the square wave, as shown in Fig. 3.1la. In the 
next step we add the dc (n = 0) and the first harmonic (fundamental), which results 
in a signal shown in Fig. 3.11b. Observe that the synthesized signal somewhat 
resembles f(t). It is a smoothed-out version of f(t). The sharp corners in f(t) 
are not reproduced in this signal because sharp corners indicate rapid changes and 
their reproduction requires rapidly varying (that is, higher frequency) components, 
which are excluded. Figure 3.11c shows the sum of de, first, and third harmonics 
(even harmonics are absent). As we increase the number of harmonics progressively, 
as illustrated in Figs. 3.11d (sum up to the fifth harmonic) and 3.1le (sum up to 


{The largest number of which By $ EE 32 are integral multiples is the ratio of the GCF 
(greatest common factor) of the numerators set (a1, a2, ---, am) to the LCM (least common 
multiple ) of the denominator set (b1, b2, ---, bm). For instance, for the set 3, $, 2), the GCF 


of the numerator set (2,6, 2) is 2; the LCM of the denominator set (3,7,1) is 21. Therefore, 4 is 


the largest number of which 2, $, and 2 are integral multiples. 
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Fig. 3.11 Synthesis of a square pulse periodic signal by successive addition of its har- 
monics. 


the nineteenth harmonic), the edges of the pulses become sharper and the signal 
resembles f(t) more closely. 


Asymptotic Rate of Amplitude Spectrum Decay 


The amplitude spectrum indicates the amounts (amplitudes) of various fre- 
quency components of f(t). If f(t) is a smooth function, its variations are less 
rapid. Synthesis of such a function requires predominantly lower-frequency sinu- 
soids and relatively small amounts of rapidly varying (higher frequency) sinusoids. 
The amplitude spectrum of such a function would decay swiftly with frequency. To 
synthesize such a function we require fewer terms in the Fourier series for a good 
approximation. In contrast, a signal with sharp changes, such as jump discontinu- 
ities, contains rapid variations and its synthesis requires a relatively large amount of 
high-frequency components. The amplitude spectrum of such a signal would decay 
slowly with frequency, and to synthesize such a function, we require many terms 
in its Fourier series for a good approximation. The square wave f(t) is a discon- 
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tinuous function with jump discontinuities, and therefore its amplitude spectrum 

decays rather slowly, as 1/n [see Eq. (3.61)]. On the other hand, the triangular 

pulse periodic signal in Fig. 3.9a is smoother because it is a continuous function (no- 
jump discontinuities). Its spectrum decays rapidly with frequency as 1/n? [see Eq. 

(3.63)}. 

We can show® that if the first k ~ 1 derivatives of a periodic signal f(t) are 
continuous and the kth derivative is discontinuous, then its amplitude spectrum Cy 
decays with frequency at least as rapidly as 1/n*+!. This result provides a simple 
and useful means for predicting the asymptotic rate of convergence of the Fourier 
series. In the case of the square-wave signal (Fig. 3.8a), the zero-th derivative of the 
signal (the signal itself) is discontinuous, so that k = 0. For the triangular periodic 
signal in Fig. 3.9a, the first derivative is discontinuous; that is, k = 1. For this 
reason, the spectra of these signals decay as 1/n and 1/n?, respectively. 


f(t) 


Fundamental 


Fig. 3.12 Role of the phase spectrum in shaping a periodic signal. 


The Role of the Phase Spectrum 


The relationship between the amplitude spectrum and the waveform f(t) is 
reasonably clear. The relationship between the phase spectrum and the periodic 
signal waveform is not so direct, however. Yet the phase spectrum plays an equally 
important role in waveshaping. We can explain this role by considering a signal f (t) 
that has rapid changes such as jump discontinuities. To synthesize an instantaneous 
change at a jump discontinuity, the phases of the various sinusoidal components in 
its spectrum must be such that all (or most) of the harmonic amplitudes will have 
one sign before the discontinuity and the opposite sign after the discontinuity. This 
will result in a sharp change in f(t) at the point of discontinuity. We can verify 
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this assertion in any waveform with jump discontinuity. Consider, for example, the 
sawtooth waveform in Fig. 3.10b. This waveform has a discontinuity at t = 1. The 
Fourier series for this waveform as given in Exercise E3.6b is 


f(t) = 24 [cos (nt — 90°) + $ cos (2nt + 90°) + 4 cos (3nt — 90°) 
+ $ cos (4rt + 90°) +--+] (3.68) 


Figure 3.12 shows the first three components of this series. The phases of all the 
(infinite) components are such that their amplitudes are positive just before t = 1 
and turn negative just after t = 1, the point of discontinuity. The same behavior 
is also observed at t = —1, where similar discontinuity occurs. This sign change 
in all the harmonics adds up to produce the jump discontinuity. In achieving a 
sharp change in the waveform, the role of the phase spectrum is crucial. If we try 
to reconstruct this signal while ignoring the phase spectrum, the result will be a 
smeared and spread-out waveform. In general the phase spectrum is just as crucial 
in determining the waveform as is the amplitude spectrum. The synthesis of any 
signal f(t) is achieved by using a proper combination of amplitudes and phases of 
various sinusoids. This unique combination is the Fourier spectrum of f (t). 


Fourier Synthesis of Discontinuous Functions: The Gibbs Phenomenon 


Fig. 3.11 shows the square function f(t) and its approximation by a truncated 
trigonometric Fourier series that includes only the first n harmonics for n=1, 3, 5, 
and 19. The plot of the truncated series approximates closely the function f(t) as 
n increases, and we expect that the series will converge exactly to f(t) as n > œ. 
This is because, as shown in Sec. 3.3, the energy of the difference between f(t) and 
its Fourier series over one period (the error energy) — 0 as n — oo. Yet the curious 
fact, as seen from Fig. 3.11, is that even for large n, the truncated series exhibits 
an oscillatory behavior and an overshoot approaching a value of about 9% in the 
vicinity of the discontinuity at the first peak of oscillation. Regardless of the value of 
n, the overshoot remains at about 9%. This strange behavior appears to contradict 
the mathematical result derived in Sec. 3.3-2 that the error energy — 0 as n — oo. 
In fact, this apparent contradiction puzzled many people at the turn of the century. 
Josiah Willard Gibbs gave a mathematical explanation of this behavior (now called 
called the Gibbs phenomenon). We can reconcile the two conflicting notions by 
observing from Fig. 3.11 that the frequency of oscillation of the synthesized signal 
is n, so the width of the spike with 9% overshoot is approximately 1/2n. As we 
increase n, the number of terms in the series, the frequency of oscillation increases 
and the spike width 1/2n diminishes. As n — oo, the error energy — 0 because the 
error consists mostly of the spikes, whose widths — 0. Therefore, as n — oo, the 
corresponding Fourier series differs from f(t) by about 9% at the immediate left 
and right of the points of discontinuity, and yet the error energy — 0. 

When we use only the first n terms in the Fourier series to synthesize a signal, 
we are abruptly terminating the series, giving a unit weight to the first n harmonics 
and zero weight to all the remaining harmonics beyond n. This abrupt termination 
of the series causes the Gibbs phenomenon in synthesis of discontinuous functions. 
More discussion on the Gibbs phenomenon, its ramifications, and cure appear in 
section 4.9. 


3.4 Trigonometric Fourier Series 205 


Fig. 3.13 Fourier Synthesis of a continuous signal using first 19 harmonics. 


Gibbs phenomenon is present only when there is a jump discontinuity in f (t). 
When a continuous function f(t) is synthesized using the first n terms of the Fourier 
series, the synthesized function approaches f(t) for all t as n — oo. No Gibbs 
phenomenon appears. Note the absence of the Gibbs phenomenon in Fig. 3.13, 
where a continuous signal is synthesized using first 19 harmonics. Compare the 
similar situation for a discontinuous signal in Fig. 3.11. 

A Exercise E3.8 


By inspection of signals in Figs. 3.7b, 3.10a, and 3.10b, determine the asymptotic rate of 
decay of their amplitude spectra. 


Answer: 1/n,1/n?, and 1/n, respectively. y 


A Historical Note on the Gibbs Phenomenon 


Normally speaking, troublesome functions with strange behavior are invented 
by mathematicians, although we rarely see such oddities in practice. In the case 
of the Gibbs phenomenon, however, the tables were turned. A rather puzzling 
behavior was observed in such a mundane object as a mechanical wave synthesizer, 
and then well-known mathematicians of the day were dispatched on the scent of it 
to discover its hide-out. 

Albert Michelson (of Michelson-Morley fame) was an intense, practical man 
who developed ingenious physical instruments of extraordinary precision, mostly in 
the field of optics. In 1898 he developed an instrument (the harmonic analyzer) 
which could compute the first 80 coefficients of the Fourier series of a signal f(t) 
specified by any graphical description. The harmonic analyzer could also be used 
as a harmonic synthesizer, which could plot a function f(t) generated by summing 
the first 80 harmonics (Fourier components) of arbitrary amplitudes and phases. 
This instrument therefore had the ability of self-checking its operation by analyzing 
a signal f(t) and then adding the resulting 80 components to see whether the sum 
yielded a close approximation of f (t). 

Michelson found that the instrument checked very well with most of signals 
analyzed. However, when he tried a discontinuous function, such as a square wave,t 
a curious behavior was observed. The sum of 80 components showed oscillatory be- 
havior (ringing) with an overshoot of 9% in the vicinity of the points of discontinuity. 
Moreover, this behavior was a constant feature regardless of the number of terms 


tActually it was a periodic sawtooth signal 
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Albert Michelson (left) and Willard J. Gibbs (right). 


added. Larger number of terms made the oscillations proportionately faster, but 
regardless of the number of terms added the overshoot remained 9%. This puzzling 
behavior caused Michelson to suspect some mechanical defect in his synthesizer. He 
wrote about his observation in a letter to Nature (December 1898). Josiah Willard 
Gibbs, an eminent mathematical physicist (inventor of vector analysis), and a pro- 
fessor at Yale, investigated and clarified this behavior for a sawtooth periodic signal 
in a letter to Nature.® Later, in 1906, Bôcher generalized the result for any function 
with discontinuity.!? It was Bôcher who gave the name Gibbs phenomenon to this 
behavior. Gibbs showed that the peculiar behavior in the synthesis of a square wave 
was inherent in the behavior of the Fourier series because of nonuniform convergence 
at the points of discontinuity. 

This, however, is not the end of the story. Both Bôcher and Gibbs were under 
the impression that this property had remained undiscovered until Gibbs’s letter 
in 1899. It is now known that the Gibbs phenomenon had been observed in 1848 
by Wilbraham of Trinity College, Cambridge, who clearly saw the behavior of the 
sum of the Fourier series components in the periodic sawtooth signal investigated 
by Gibbs.!! Apparently, this work was not known to most people, including Gibbs 
and Bôcher. 


3.5 Exponential Fourier Series 


It is shown in Appendix 3C that the set of exponentials e7™0* (n = 0, +1, +2,...) 
is orthogonal over any interval of duration To = 27/wo, that is, 


0 
f elmusot (ejnwot)* gt = | ed(m—njwot gy = (3.69) 
To To To Dr pee 
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Moreover, this set is a complete set.° 7 From Eqs. (3.44) and (3.45), it follows 


that a signal f(t) can be expressed over an interval of duration To seconds as an 
exponential Fourier series 


foe) 
f= SS Dreta (3.70) 
n=~0o 
where [see Eq. (3.45)] 
1 
Da = To Ja f(t)e iot qt (3.71) 
o 


The exponential Fourier series is basically another form of the trigonometric Fourier 
series. Each sinusoid of frequency w can be expressed as a sum of two exponentials 
efet and e~~t, This results in the exponential Fourier series consisting of compo- 
nents of the form e/"! with n varying from —oo to oo. The exponential Fourier 
series in Eq. (3.70) is periodic with period Tp. 

In order to see its close connection with the trigonometric series, we shall 
rederive the exponential Fourier series from the trigonometric Fourier series. A 


sinusoid in the trigonometric series can be expressed as a sum of two exponentials 
using Euler’s formula: 


Cn cos (nwot + On) Sa [efimunt+6n) + garena] 


(Fe) einwot 4. (Se) e—inwot 
2 2 


Dn D-n 


il 


= Dpei™ot 4 D_pe iot (3.72) 


The compact trigonometric Fourier series of a periodic signal f(t) is given by 


f(t)=Co+ 5D Cn cos (nwot + On) 


n=1 


Use of Eq. (3.72) in the above equation (and letting Co = Do) yields 


co 
f(t)=Dot+ 5 Dyei™t + D_,eIrwot 


n=1 


oo 
= D Dpeim™ot 


n=—00 


which is precisely Eq. (3.70) derived earlier. Observe the compactness of expressions 
(3.70) and (3.71) and compare them to expressions corresponding to the trigono- 
metric Fourier series. These two equations clearly demonstrate the principle virtue 
of the exponential Fourier series. First, the form of the series is more compact. 
Second, the mathematical expression for deriving the coefficients of the series is 
also compact. The exponential series is far more convenient to handle than the 
trigonometric one. In the system analysis also, the exponential form proves more 
convenient than the trigonometric form. For these reasons we shall use exponential 
(rather than trigonometric) representation of signals in the rest of the book. 
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The connection between the trigonometric and exponential series coefficients 
is clear in Eq. (3.72): 


Dn = bOne” 
D-n = Cnet” (3.73) 


The connection between the trigonometric and the exponential Series also becomes 
clear when we substitute e~#”' = cos wt — j sin wt in Eq. (3.71) to obtain 


Dn = (on m jbn) (3.74) 


E Example 3.6 i 
Find the exponential Fourier series for the signal in Fig. 3.7b (Example 3.3). 
In this case To = 7, wo = 27 /To = 2, and 


oo 
y(t)= YO Dne?n* 


n=—0o 
where 
1 gant gt 
Dy = T y(t)e 
0 JT 
a 1 [ en t/? eint at 
T Jo 
= if eT (3 ts2n)t dt 
T Jo 
< ests eo ($ +i2n)t 
T (3 + j2n) i 
= an (3.75) 
jan 
and 
y(t) = 0.504 X pee (3.76a) 
n=-00 J 
: f t 
= 0.504 [1 + gad” + age + me te 
tpe” aetti] (8.760) 


Observe that the coefficients Dn are complex. Moreover, Dn and D-n are conjugates as 
expected [see Eq. (3.73)]. a 


3.5-1 Exponential Fourier Spectra 


In exponential spectra, we plot coefficients Dn as a function of w. But since 
Dn is complex in general, we need two plots: the real and the imaginary parts of 
Dn, or the magnitude and the angle of Dn. We prefer the latter because of its 
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close connection to the amplitudes and phases of corresponding components of the 
trigonometric Fourier series. We therefore plot |D,| vs. w and Dn vs. w. This 


requires that the coefficients D, be expressed in polar form as [Dnler4Pn, 
Comparison of Eqs. (3.51a) and (3.71) (for n = 0) shows that 


Do = a9 = Co (3.77a) 


Equation (3.73) shows that, for real f(t), the twin coefficients D, and D-n are 
conjugates, and 


1 
[Dal =|D-nl=5Cn on #0 (3.77b) 
ZDn=6, and LD_»=—On (3.77c) 
Thus, i ' 
Dn =|Dn]e and Dn = |Dn]e7i® (3.77d) 


where |Dn| are the magnitudes and 2D, are the angles of various exponential 
components. From Eqs. (3.77) it follows that the magnitude spectrum (|D,| vs. w) 
is an even function of w and the angle spectrum (2D, vs. w) is an odd function of 
w when f(t) is a real signal. 

For the series in Example 3.6 (Eq. (3.76b)], for instance, 


Di= eer = 0.122¢~475-96° —» |, | = 0.122, LD, = —75.96° 


7”: 4 f o 
D= = = 0.122¢775-96° —> |D 1| = 0.122, ZD_, = 75.96° 


and 

_ 0.504 
T IFJj8 
_ 0.504 
ae 


2 = 0.0625e7182:8° —> |D3| = 0.0625, LD2 = —82.87° 


= = 0.0625¢76?:87" — |D_»| = 0.0625, ZD_» = 82.87° 
and so on. Note that D, and D-n are conjugates, as expected [see Eqs. (3.77)]. 

Figure 3.14 shows the frequency spectra (amplitude and angle) of the exponen- 
tial Fourier series for the periodic signal y(t) in Fig. 3.7b. 

We notice some interesting features of these spectra. First, the spectra exist 
for positive as well as negative values of w (the frequency). Second, the amplitude 
spectrum is an even function of w and the angle spectrum is an odd function of 
w. Finally, we see a close connection between these spectra and the spectra of the 
corresponding trigonometric Fourier series for y(t) (Figs. 3.7c and d). 


What is a Negative Frequency? 


The existence of the spectrum at negative frequencies is somewhat disturbing 
because, by definition, the frequency (number of repetitions per second) is a positive 
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Fig. 3.14 Exponential Fourier spectra for the signal in Fig. 3.7a. 


quantity. How do we interpret a negative frequency? Using a trigonometric identity, 
we can express a sinusoid of a negative frequency —wo as 


cos (~—wot + @) = cos (wot — 8) 


This equation clearly shows that the frequency of a sinusoid cos (wot + 8) is |wol, 
which is a positive quantity. The same conclusion is reached by observing that 


etivot — cos wot + j sin wot 


Thus, the frequency of exponentials etjvot is indeed |wo|. How do we then interpret 
the spectral plots for negative values of w? A healthier way of looking at the situa- 
tion is to say that exponential spectra are a graphical representation of coefficients 
Dn as a function ofw. Existence of the spectrum at w = —nwg is merely an indi- 
cation of the fact that an exponential component e In~ot exists in the series. We 
know that (see Eq. (3.72)} a sinusoid of frequency nwo can be expressed in terms of 
a pair of exponentials e/"°? and e~I™0*, 

Equation (3.77) shows the close connection between the trigonometric spectra 
(Cn and 6,) with exponential spectra (|Dn| and ZDn). The dc components Do and 
Co are identical in both spectra. Moreover, the exponential amplitude spectrum 
|D,| is half of the trigonometric amplitude spectrum Cn for n > 1. The exponen- 
tial angle spectrum 2D, is identical to the trigonometric phase spectrum ôn for 
n > 0. We can therefore produce the exponential spectra merely by inspection of 
trigonometric spectra, and vice versa. The following example demonstrates this 
feature. 


E Example 3.7 

The trigonometric Fourier spectra of a certain periodic signal f(t) are shown in Fig. 
3.15a. By inspecting these spectra, sketch the corresponding exponential Fourier spectra 
and verify your results analytically. 
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$ 
Cpa 


16 


Fig. 3.15 Spectra for Example 3.7. 


The trigonometric spectral components exist at frequencies 0,3,6, and 9. The expo- 
nential spectral components exist at 0, 3, 6,9 and —3, —6, —9. Consider first the amplitude 
spectrum. The dc component remains unchanged; that is, Do = Co = 16. Now |D,,| is 
an even function of w and |Dn| = |D-n| = Cn/2. Thus, all the remaining spectrum |Dn| 
for positive n is half the trigonometric amplitude spectrum Cn, and the spectrum |D,,| for 
negative n is a reflection about the vertical axis of the spectrum for positive n, as shown 
in Fig. 3.15b. 

The angle spectrum 4D, = ĝn for positive n and is —@, for negative n, as depicted 
in Fig. 3.15b. We shall now verify that both sets of spectra represent the same signal. 

Signal f(t) whose trigonometric spectra are shown in Fig. 3.15a, has four spectral 
components of frequencies 0, 3, 6, and 9. The dc component is 16. The amplitude and 
the phase of the component of frequency 3 are 12 and —4, respectively. Therefore, this 
component can be expressed as 12cos (3t — $). Proceeding in this manner, we can writs 
the Fourier series for f(t) as 


f(t) = 16 + 12cos (3t - 3) + 8cos (6t — Z) + 4cos (9t es z) 


Consider now the exponential spectra in Fig. 3.15b. They contain components of 
Tednencies 0 (dc), +3, +6, and +9. The dc component is Do = 16. The component 
: ey 3) has magnitude 6 and angle — . Therefore, this component strength is 
6e a i can be expressed as (6e ~? 4 jelt, Similarly, the component of frequency —3 
is (6e74 )e-?"". Proceeding in this manner, f(t), the signal corresponding to the spectra 


in Fig. 3.15b, is 

f(t) =16 + [Be E et + Gei eI] + [de FF eI 4 pei? eI] 4 [eI F CI y 2ef i e739] 
= 16 +6 [E 4 eE] 4g [E 4 eD] 4 9 [eE 4 gt] 
= 16 + 12cos (3t — F) + 8cos (6t — $) + 4cos (9% - 4) 


Clearly both sets of spectra represent the same periodic signal. E 
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Bandwidth of a Signal 


The difference between the highest and the lowest frequencies of the spectral 
components of a signal is the bandwidth of the signal. The bandwidth of the 
signal whose exponential spectra are shown in Fig. 3.15b is 9 (in radians). The 
highest and lowest frequencies are 9 and 0 respectively. Note that the component of 
frequency 12 has zero amplitude and is nonexistent. Moreover, the lowest frequency 
is 0, not —9. Recall that the frequencies (in the conventional sense) of the spectral 
components at w = —3, —6, and —9 in reality are 3, 6, and 9.{ The bandwidth can 
be more readily seen from the trigonometric spectra in Fig. 3.15a. 


W Example 3.8 

Find the exponential Fourier series and sketch the corresponding spectra for the 
impulse train 67)(t) depicted in Fig. 3.16a. From this result sketch the trigonometric 
spectrum and write the trigonometric Fourier series for ôn, (t). 

The exponential Fourier series is given by 


6m (t) = D Dpnet™ot wo 


n=- 


2r 


=F (3.78) 


where 


1 zá 
Dn = => | 6r(t)e 7" dt 
To To 
Choosing the interval of integration cB, 2) and recognizing that over this interval 
Sry (t) = 8(t), 


1 pr f 

Dnr = ral 6(t)e 7" dt 
To —To/2 

In this integral the impulse is located at t = 0. From the sampling property (1.24a), 

the integral on the right-hand side is the value of e~2"°! at ¢ = 0 (where the impulse is 


located). Therefore 
1 


~ Tp 


Substitution of this value in Eq. (3.78) yields the desired exponential Fourier series 


Dn (3.79) 


o0 


Sn (t) = z Y eine? w= a (3.80) 
n=- 
Equation (3.79) shows that the exponential spectrum is uniform (Dn = 1/To) for all the 
frequencies, as shown in Fig. 3.16b. The spectrum, being real, requires only the amplitude 
plot. All phases are zero. 
To sketch the trigonometric spectrum, we use Eq. (3.77) to obtain 
1 


=D =% 


2 
Cn = aa = 1,2,3, 
4Dnl =F m= 1,28 
On = 0 


{Some authors do define bandwidth as the difference between the highest and the lowest (negative) 
frequency in the exponential spectrum. The bandwidth according to this definition is twice that 
defined here. In reality, this definition defines not the signal bandwidth but the spectral width 
(width of the exponential spectrum of the signal). 
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f(t) = 8p (t) 


— 


(b) 


-200 -0% 205 o-~ 


~3@o 


Fig. 3.16 Impulse train and its Fourier spectra. 


Figure 3.16c shows the trigonometric Fourier spectrum. From this spectrum we can express 
ôm, (t) as 
ên (t) = x [L + 2(cos wot + cos 2wot + cos 3wot + ---)] wo = = (3.81) 
i E 
Effect of Symmetry in Exponentia! Fourier Series 
When f(t) has an even symmetry, bn = 0, and from Eq. (3.74), Dn = an/2, 
which is real (positive or negative). Hence, 4D, can only be 0 or +r. Moreover, we 
may compute Dn = a,/2 using Eq. (3.66b), which requires integration over a half 
period only. Similarly, when f(t) has an odd symmetry, an = 0, and Dn = — jbn/2 
is imaginary (positive or negative). Hence, /D,, can only be 0 or +7/2. Moreover, 
we may compute Dn = —jb,/2 using Eq. (3.67b), which requires integration over 
a half period only. Note, however, that in the exponential case, we are using the 
symmetry property indirectly by finding the trigonometric coefficients. We cannot 
apply it directly to find D,, from eq. (3.71). 
A Exercise E3.9 
The exponential Fourier spectra of a certain periodic signal f (t) are shown in Fig. 3.17. 
Determine and sketch the trigonometric Fourier spectra of f(t) by inspection of Fig. 3.17. Now 
write the (compact) trigonometric Fourier series for f(t). 
Answer: f(t) = 4 + 6cos (3t - $) +2cos (6t - 4) + 4cos (9¢- 3) 7 


A Exercise E3.10 
Find the exponential Fourier series and sketch the corresponding Fourier spectrum Dn vs. w 
for the full-wave rectified sine wave depicted in Fig. 3.18. 


oo 
2 1 A 
== j2nt y 
FO T D 1 — 4n2 s 


n=—oo 


Answer: 
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oR = 0 n 27 Eg 


Fig. 3.18 A full-wave rectified sine wave in Exercise £3.10. 


3.5-2  Parseval’s Theorem 


The trigonometric Fourier series of a periodic signal f(t) is given by 


oo 
f(t) = Co + Ý Cn cos (nwot + On) 

n=1 
Every term on the right-hand side of this equation is a power signal. Moreover, 
all the Fourier components on the right-hand side are orthogonal over one period. 
Hence, the power of f(t) is equal to the power of the sum of all the sinusoidal 
components on the right-hand side. We already demonstrated in Example 1.2 that 
the power of the sum of sinusoids is equal to the sum of the powers of all the 
sinusoids. Moreover, the power of a sinusoid of amplitude C'n is Cn /2 regardless 
of the values of its frequency phase, and the power of a de term Co is Co”. Thus, 
the power of f(t) is given by 


foe) 
Ps =Cy? + ; Soc, (3.82) 

n=1 
This result, which is an alternate form of Eq. (3.42), is the Parseval’s theorem 
(for Fourier series). It states that the power of a periodic signal is equal to the sum 
of the powers of its Fourier components. ne 
We can apply the same argument to the exponential Fourier series, which a 
also made up of the orthogonal components. Hence, the power of a periodic gre 
f(t) can be expressed as a sum of the powers of its exponential ae 
Eq. (1.5d), we showed that the power of an exponential De! ot is |D |. Using se 
result we can express the power of a periodic signal f(t) in terms of its exponentia 


Fourier series coefficients as 
oo 


P= Ss Dal? (3.83a) 


n=—-oco 
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cosa, t-8 


10 cost +8 0.10247, 10 cos @,1+8 


Fig. 3.19 (a) A clipped sinusoid cos wot (b) the distortion component fa(t) of the signal 
in (a). 


For a real f(t), |D_n| = |Dn]. Therefore 


co 
Ps = Do? +2 Y Dz)? (3.83b) 


n=1 


E Example 3.9 

The input signal to an audio amplifier of gain 100 is given by x(t) = 0.1 cos wot. 
Hence, the output is a sinusoid 10 cos wot. However, the amplifier, being nonlinear at 
higher amplitude levels, clips all amplitudes beyond +8 volts as shown in Fig. 3.19a. We 
shall determine the harmonic distortion incurred in this operation. 

The output y(t) is the clipped signal in Fig. 3.19a. The distortion signal yq(t), shown 
in Fig. 3.19b, is the difference between the undistorted sinusoid 10 cos wot and the output 


signal y(t). The signal ya(t), whose period is To [the same as that of y(t)] can be described 
over the first cycle as 


10 cos wot — 8 lt} < 0.10247 
ya(t) = { 10 coswot+8 I —0.1024To < |t| < I + 0.1024 
0 everywhere else 


Observe that ya(t) is an even function of t and its mean value is zero. Moreover, bn = 0, 
and Cn = an. Hence, its Fourier series can be expressed as 


oo 
yalt) = D Cr cos nwot 
n=1 


As usual, we can compute the coefficients Cn (which is equal to an) by integrating 
ya(t) cos nwot over one cycle (and then dividing by 2/ To). Because ya(t) has even sym- 
metry, we can find an by integrating the expression over half cycle only using Eq. (3.66b). 
The straightforward evaluation of the appropriate integral yields} 


fIn addition, yg(t) exhibits half-wave symmetry (see Prob. 3.4-7), where the second half cycle is 
the negative of the first half cycle. Because of this property, all the even harmonics vanish, and 
the odd harmonics can be computed by integrating the appropriate expressions over the first half 
cycle only (from —To/4 to To/4) and doubling the resulting values. Moreover, because of even 
symmetry, we can integrate the appropriate expressions over 0 to To /4 (instead of from —Tp/4 to 
To/4) and double the resulting values. In essence, this allows us to compute Cy by integrating the 
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20 [sin [0.6435(n+1 sin [0.6435(n—1)]] _ 32 {= 0.6435n 

2f nyi + nai ]|-# SD] nodd 

0 n even 
Computing the coefficients C1, C2, C3, --- from this expression, we can write 


yalt) = 1.04 cos wot + 0.733 cos 3wot + 0.311 cos Swot +- 


Computing Harmonic Distortion 

In this case, we can compute the amount of distortion in the output signal by com- 
puting the power of the distortion component ya(t). Because ya(t) is an even function of 
t and because the power in the first half cycle is identical to the power in the second half 
cycle, we can compute the power by averaging the energy over a quarter cycle. Thus 


1 To [2 
Pj = = ya (t) dt 
To —To/2 
1 To/4 g 

= —— t) dt 
To/4 f va (t) 
4 0.1024To 

== (10 cos wot — 8)° dt 
To 0 

0.865 


The power of the desired signal 10cos wot is (10)?/2 = 50. Hence, the total harmonic 
distortion is 
0.865 


Dio = 50 x 100 = 1.73% 


The powers of the first harmonic and the third harmonic components of ya(t) are 
(1.04)?/2 = 0.5408 and (0.726)?/2 = 0.2635, respectively. Hence, the first harmonic 
and the third harmonic distortions are 


_ 0.5408 0.2635 


1= x 100 = 1.08% and D3 = x 100 = 0.527% W 


3.6 Numerical Computation of D, 


We can compute D,, numerically using the DFT (the discrete Fourier transform 
discussed in Sec. 5.2), which uses the samples of a periodic signal f(t) over one 
period. The sampling interval is T seconds. Hence, there are No = To/T number 
of samples in one period To. To find the relationship between. Dn and the samples 
of f(t), consider Eq. (3.71) 


expression over the quarter cycle only and then quadrupling the resulting values. Thus 


0.10247 
Cn = an = = {10 cos wot — 8] cos nwot dt 
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1 r 
Dn=— | f(t)e I" dt 
To 


1 No-1 
= lim — So f(kT)e ITT 
k=0 


No-1 


1 ; 
= ~—jnQNXok 
jim No 2 F(kT)e (3.84) 


where f (kT) is the kth sample of f(t) and 


N= a, No = wT = = (3.85) 

In practice, it is impossible to make T — 0 in computing the right-hand side 
of Eq. (3.84). We can make T small, but not zero, which will cause the data to 
increase without limit. Thus, we shall ignore the limit on T in Eq. (3.84) with the 
implicit understanding that T is reasonably small. Nonzero T will result in some 
computational error, which is inevitable in any numerical evaluation of an integral. 
The error resulting from nonzero T is called the aliasing error, which is discussed 
in more details in Chapter 5. Thus, we can express Eq. (3.84) as 


1 No-1 
Dn = — kT )e7In Sok 3.86a 
No 2 f (kT je ( ) 


Now, from Eq. (3.85), QoNo 
(3.86a), it follows that 


Qn. Hence, eJ™o(kt+No) = eink and from Eq. 


Dn+No = Dn (3.86b) 


Clearly, the Fourier spectrum Dn repeats periodically with period No, which causes 
spectral overlap due to repeating cycles. To understand the nature of this overlap, 
see Fig. 5.12f. Generally, Dn decays with n and the spectral overlap caused by the 
periodic repetition will have negligible effect if we use large enough No (the period). 
The first cycle intersects the second cycle at n = No/2. Hence, overlapping will be 
negligible if Dn is very small for n > No/2. Because of the periodicity of Dn, we need 
to evaluate only No values of Dn over the range n = —No/2 to No/2— 1. However, 
the DFT (or FFT) computes Dn for n = 0 to No — 1. The periodicity property 
Dn+No = Dn means, beyond n = No/2, the coefficients represent the values for 
negative n. For instance, when No = 32, Di7 = D-15, Dig = D-14, t, D31 = 
D_ . The cycle repeats again from n = 32 on. 

We can use the efficient FFT (the fast Fourier transform discussed in Sec. 
5.3) to compute the right-hand side of the above equation. We shall use MATLAB 
to implement the FFT algorithm. For this purpose, we need samples of f(t) over 
one period starting at t = 0. In this algorithm, it is also preferable (although not 
necessary) that No be a power of 2, that is No = 2™, where m is an integer. 


© Computer Example C3.1 
Compute and plot the trigonometric and exponential Fourier spectra for the periodic 
signal in Fig. 3.7b (Example 3.3). 
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The samples of f(t) start at t = 0 and the last (No-th) sample is at t = To — T (the 
last sample is not at t = To because the sample at t = 0 is identical to the sample at t = To, 
and the next cycle begins at t = Ty). At the points of discontinuity, the sample value is 
taken as the average of the values of the function on two sides of the discontinuity. Thus, 
in the present case, the first sample (at t = 0) is not 1, but (e~7/? + 1)/2 = 0.604. To 
determine No, we require that Dn for n > No/2 to be negligible. Because f(t) has a jump 
discontinuity, D, decays rather slowly as 1/n. Hence, choice of No = 200 is acceptable 
because the (No/2)-nd (100th) harmonic is about 0.01 (about 1%) of the fundamental. 
However, we also require No to be power of 2. Hence, we shall take No = 256 = 28, 

We write and save a MATLAB file (or program) c3l.m to compute and plot the 
exponential Fourier coefficients. 


% (c31.m) 

%M is the number of coefficients to be computed 
TO=pi;NO=256;T=T0/N0;M=10; 
t=0:T:T*(NO-1); t=t’; 

f=exp(-t/2)3f(1)=0.604; 

% fft(f) is the FFT [the sum on the right-hand side of Eq. (3.86)] 
Dn=fft(f)/NO 

(Dnangle, Dnmag]=cart2pol(real(Dn),imag(Dn)); 
k=0:length(Dn)-1;k=k’; 
subplot(211),stem(k,Dnmag) 

subplot(212), stem(k,Dnangle) 


To compute trigonometric Fourier series coefficients, we recall the program c3l.m 
along with commands to convert Dn into Cn and ĉn. 


c31;clg 

CO=Dnmag(1); Cn=2*Dnmag(2:M); 
Amplitudes=[C0;Cn] 
Angles=Dnangle(1:M); 
Angles=Angles*(180/pi); 
disp(’Amplitudes Angles’) 
[Amplitudes Angles] 

% To Plot the Fourier coefficients 
k=0:length( Amplitudes)-1; k=k’; 
subplot (211 ),stem(k,Amplitudes) 
subplot(212), stem(k,Angles) 


ans = 
Amplitudes Angles 
0.5043 0 
0.2446 -75.9622 
0.1251 -82.8719 
0.0837 -85.2317 
0.0629 -86.4175 
0.0503 -87.1299 
0.0419 -87 .6048 
0.0359 -87 .9437 
0.0314 -88.1977 
0.0279 -88.3949 ©) 
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3.7 LTIC System Response to periodic Inputs 


A periodic signal can be expressed as a sum of everlasting exponentials (or 
sinusoids). We also know how to find the response of an LTIC system to an ever- 
lasting exponential. From this information we can readily determine the response 
of an LTIC system to periodic inputs. A periodic signal f(t) with period Tp can be 
expressed as an exponential Fourier series 

= 2r 
— jrwot pap 
f(t) ee Dne wo To 
In Sec. 2.4-3, we showed that the response of an LTIC system with transfer func- 
tion H (s) to an everlasting exponential input e*t is also an everlasting exponential 
H (s)e%. Therefore, the system response to everlasting exponential e?“* is an ever- 
lasting exponential H (jw)e*t. This input-output pair can be displayed ast 


eft — H (jw)es¥* 
~w ie peti 


input 


output 
Therefore, from linearity property 
c9 + o9 a 
D Dyeiret — > DnH (jnwo)je?™ot (3.87) 
n=- n=—00 
input f(t) response y(t) 


The response y(t) is obtained in the form of an exponential Fourier series, and is 
therefore a periodic signal of the same period as that of the input. 
We shall demonstrate the utility of these results by the following example. 


E Example 3.9 

A full-wave rectifier (Fig. 3.20a) is used to obtain a dc signal from a sinusoid sin t. 
The rectified signal f(t), depicted in Fig. 3.18, is applied to the input of a a low-pass RC 
filter, which suppresses the time-varying component and yields a dc component with some 
residual ripple. Find the filter output y(t). Find also the dc output and the rms value of 
the ripple voltage. 

First, we shall find the Fourier series for the rectified signal f(t), whose period is 
To = w. Consequently, wo = 2, and 


IO = J Duel" 


n=- 
where 


ae ey ie —jant 4, _ 2 
Dy = = [ sin t e dt = aoa (3.88) 


{This result applies only to the asymptotically stable systems. This is because when s = jw, the 
integral on the right-hand side of Eq. (2.48) does not converge for unstable systems. Moreover, for 
marginally stable systems also, that integral does not converge in the ordinary sense, and H(jw) 
cannot be obtained by replacing s in H(s) with jw. 
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Full-Wave y(t) (a) 


sin t Rectifier 


y(t) l @ 


-3n 0 t— 3n 


Fig. 3.20 A full-wave rectifier with a lowpass filter and its output. 


Therefore = 


f) = 9 mL Ta 


=00 


Next, we find the transfer function of the RC filter in Fig. 3.20a. This filter is identical 
to the RC circuit in Example 1.11 (Fig. 1.32) for which the differential equation relating 
the output (capacitor voltage) to the input f(t) was found to be {Eq. (1.60)] 


(3D + 1)y(t) = FE) 


The transfer function H(s) for this system is found from Eq. (2.50) as 


i 
H(s) = 3s+1 
and 1 
iw) = ———_ 3.89 
HOO) = a (3:89) 


From Eq. (3.87), the filter output y(t) can be expressed as (with wo = 2) 


oo Co 
y(t) = JO Dalmo) = F Dall jane 


n=—0O nS—= 00 


Substituting Dn and H(j2n) from Eqs. (3.88) and (3.89) in the above equation, we obtain 


oo 


2 jant 
w=) a mAn" ean 


n=~-00 


Note that the output y(t) is also a periodic signal given by the exponential Fourier series 
on the right-hand side. The output is numerically computed from the above equation and 
plotted in Fig. 3.20b. 
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The output Fourier series coefficient corresponding to n = 0 is the de component 
of the output, given by 2/7. The remaining terms in the Fourier series constitute the 
unwanted component called the ripple. We can determine the rms value of the ripple 
voltage by finding the power of the ripple component using Eq. (3.83). The power of 
the ripple is the power of all the components except the de (n = 0). Note that Dn, the 
exponential Fourier coefficient for the output y(t) is 


2 


oe m(1 — 4n2)(j6n + 1) 


Therefore, from Eq. (3.83b), we have 
oo 


Pripple = 237 IDal? 25 


n=l n=l 


2 2 


m(1 — 4n?)(j6n + 1) 


8 1 
ee 2 (1 — 4n?)2(36n? + 1) 
E 


Numerical computation of the right-hand side yields 
Pripple = 0.0025, and the ripple rms value =,/ Prippie = 0.05 


This shows that the rms ripple voltage is 5% of the amplitude of the input sinusoid. $i 


Why Use Exponentials? 


The exponential Fourier series is just another way of representing trigonomet- 
ric Fourier series (or vice versa). The two forms carry identical information—no 
more, no less. The reasons for preferring the exponential form have already been 
mentioned: This form is more compact, and the expression for deriving the expo- 
nential coefficients is also more compact, as compared to those in the trigonometric 
series. Furthermore, the system response to exponential signals is also simpler 
(more compact) than the system response to sinusoids. In addition, the mathemat- 
ical manipulation and handling of exponential form proves much easier than the 
trigonometric form in the area of signals as well as systems. For these reasons, in 
our future discussion we shall use the exponential form exclusively. 

A minor disadvantage of the exponential form is that it cannot be visualized 
as easily as sinusoids. For intuitive and qualitative understanding, the sinusoids 
have the edge over exponentials. Fortunately, this difficulty can be overcome read- 
ily because of close connection between exponential and Fourier spectra. For the 
purpose of mathematical analysis we shall continue to use exponential signals and 
spectra, but to understand the physical situation intuitively or qualitatively we shall 
speak in terms of sinusoids and trigonometric spectra. Thus, in future discussions, 
although all mathematical manipulation will be in terms of exponential spectra, we 
shall speak of exponential and sinusoids interchangeably when discussing intuitive 
and qualitative insights and the understanding of physical situations. This is an 
important point; readers should make an extra effort to familiarize themselves with 
the two forms of spectra, their relationships, and their convertibility. 


Dual Personality of a Signal 


The discussion so far shows that a periodic signal has a dual personality—the 
time domain and frequency domain. It can be described by its waveform or by its 
Fourier spectra. The time- and frequency-domain descriptions provide complemen- 
tary insights into a signal. For in-depth perspective, we need to understand both of 
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these identities. It is important for the reader to learn to think of a signal from both 
of these perspectives. In the next chapter, we shall see that aperiodic signals also 
have this dual personality. Moreover, we shall show that even LTI systems have this 
dual personality, which offers complementary insights into the system behavior. 


Limitations of the Fourier Series Method of Analysis 


We have developed here a method of representing a periodic signal as a weighted 
sum of everlasting exponentials whose frequencies lie along the jw-axis in the s- 
plane. This representation (Fourier series) is valuable in many applications. How- 
ever, as a tool for analyzing linear systems, it has serious limitations and conse- 
quently has limited utility for the following reasons: 


1. The Fourier series can be used only for periodic inputs. All practical inputs 
are aperiodic (remember that a periodic signal starts at t = —oo). 


2. This technique can be applied readily to asymptotically stable systems. It 
cannot handle so easily unstable or even marginally stable systems (see the 
footnote on p. 219). 


The first limitation can be overcome by representing aperiodic signals in terms 
of everlasting exponentials. This representation can be achieved through the Fourier 
integral, which may be considered as an extension of the Fourier series. We shall 
therefore use the Fourier series as a stepping stone to the Fourier integral developed 
in the next chapter. The second limitation can be overcome by using exponentials 
e% where s is not restricted to the imaginary axis, but is free to take on complex 
values. This generalization leads to the Laplace integral, discussed in Chapter 6 
(the Laplace transform). 


3.8 Appendix 


Appendix 3A: Derivation of Eq. (3.39) 


The error e(t) in the approximation (3.37) 
N 


elt) = f(t) - $. entn(t) (3.91) 


n=l 
The error energy Ee is 


te te N 2 
= e? = - CnT . 
E= [ (x) ae ia Q Len so) dt (3.92) 


Since Ee is a function of N parameters c1, c2, ..., cn, to minimize Ee, a necessary 
condition is 


2 
ðE a f® x l 
peor ae -> nln = SLA eres bf 3. 
ðci Oey [ o 2 a i á 


When we expand the integrand, we find that all the cross-product terms arising 
from the orthogonal signals are zero by virtue of orthogonality; that is, all terms of 
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the form f 2m(t)zn(t) dt with m Æ n vanish. Similarly, the derivative with respect 
to c; of all terms not containing c; is zero. For each i, this observation leaves only 
two nonzero terms in Eq. (3.93): 


t2 
2 [-2c:f (t)z:(t) + ci?z: (t)) dt=0 
Oc: Jt, 
or 
tz t2 
—2 |] f(t)z:(t)dt +26, f a(t)dt=0 i=1,2,...,n 
ty ti 
Therefore 
t2 
f(t)ai(t) dt 1 fe 
a= 4; = g| f@alde i=1,2..,N (3.94) 


Derivation of Eq. (3.40) 


t2 N : 
e= f ro- Zento] dt 


ta 2 `x 2 kg 2 x j 
-f f Gurie Í En (at-2 Yen | f(t)an(t) dt 


1 


Substitution of Eqs. (3.36) and (3.94) in this equation yields 


N N 
e= | F(t)dt+ So cn En-2) cn? En 
ti n=1 n=l 
te N 
=| f*(t)dt-} oon? En (3.95) 
tı n=1 


As N — œ for a complete orthogonal set, Ee — 0, and the energy of f (t) is equal to 
the sum of energies of all the orthogonal components c121(t), cor2(t), c3x3(t), =+. 
Appendix 3B: Orthogonality of the Trigonometric Signa! Set 

Consider an integral 7 defined by 


I= | cos nwot cos muot dt (3.96a) 
To 


where Jn stands for integration over any contiguous interval of Tp seconds. By 
using a trigonometric identity (see Sec. B.7-6), Eq. (3.96a) can be expressed as 


J= 2 p cos (n + m)wot dt +f cos (n — m)wot a| (3.96b) 
2 To To 
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Since cos wot executes one complete cycle during any interval of Ty duration, cos (n+ 
m Jwot executes (n + m) complete cycles during any interval of duration To. There- 
fore, the first integral in Eq. (3.96b), which represents the area under (n + m) 
complete cycles of a sinusoid, equals zero. The same argument shows that the sec- 
ond integral in Eq. (3.96b) is also zero, except when n = m. Hence J in Eq. (3.96) 
is zero for all n Æ m. When n = m, the first integral in Eq. (3.96b) is still zero, but 


the second integral yields 
jai f aaa 
2 Jn 2 


Thus 
0 ném 
j cos nwot cos mwotdt = 4 z (3.97a) 
To > m=n#0 
Using similar arguments, we can show that 
0 ném 
Í sin nwot sin mwot dt = a (3.97b) 
To 3 n=m #0 
and 
| sin nwot cos mwotdt = 0 for all n and m (3.97c) 
To 


Appendix 3C: Orthogonality of the Exponential Signal Set 


The set of exponentials e/0# (n = 0, +1, +2,...) is orthogonal over any inter- 
val of duration To, that is, 


: : 0 men 
f ei Moot (einwot)* gt = f ef(m—n)wot dt = (3.98) 
To To To m=n 
Let the integral on the left-hand side of Eq. (3.98) be J. 
I= f ef Muot(ginwoty* dt = i ellm—n)uot gt (3.99) 
To To 


The case m = n is trivial. In this case the integrand is unity, and I = Ty. When 


men 


t1+To = 1 ed(m—n)wotr fei(m—n)woT am 1] =0 


t  j(m—n)wo 


1 


T= edim—n)wot 
j(m ~ n)wo 


The last result follows from the fact that woTp = 27, and e/?** = 1 for all integral 


values of k. 
3.9 Summary 


This chapter discusses the foundations of signal representation in terms of its 
components. There is a perfect analogy between vectors and signals; the analogy is 
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so strong that the term ‘analogy’ understates the reality. Signals are not just like 
vectors. Signals are vectors. The inner or scalar product of two (real) signals is the 
area under the product of the two signals. If this inner or scalar product is zero, 
the signals are said to be orthogonal. A signal f(t) has a component cz(t), where 
c is the inner product of f(t) and x(t) divided by Ez, the energy of x(t). 


A good measure of similarity of two signals f(t) and z(t) is the correlation co- 
efficient cn, which is equal to the inner product of f(t) and z(t) divided by ,/E pes. 
It can be shown that —1 < cn < 1. The maximum similarity (cn = 1) occurs only 
when the two signals have the same waveform within a (positive) multiplicative 
constant, that is, when f(t) = Ka(t). The maximum dissimilarity (cn = —1) oc- 
curs only when f(t) = —K x(t). Zero similarity (cn = 0) occurs when the signals 
are orthogonal. In binary communication, where we are required to distinguish 
between the two known waveforms in the presence of noise and distortion, select- 
ing the two waveforms with maximum dissimilarity (cn = —1) provides maximum 
distinguishability. 


Just as a vector can be represented by the sum of its orthogonal components 
in a complete orthogonal vector space, a signal can also be represented by the 
sum of its orthogonal components in a complete orthogonal signal space. Such a 
representation is known as the generalized Fourier series representation. A vector 
can be represented by its orthogonal components in many different ways, depending 
on the coordinate system used. Similarly a signal can be represented in terms of 
different orthogonal signal sets of which the trigonometric and the exponential signal 
sets are two examples. We have shown that the trigonometric and exponential 
Fourier series are periodic with period equal to that of the fundamental in the 
set. In this chapter we have shown how a periodic signal can be represented as a 
sum of (everlasting) sinusoids or exponentials. If the frequency of a periodic signal 
is wo, then it can be expressed as a sum of the sinusoid of frequency wo and its 
harmonics (trigonometric Fourier series). We can reconstruct the periodic signal 
from a knowledge of the amplitudes and phases of these sinusoidal components 
(amplitude and phase spectra). 


If a periodic signal has an even symmetry, the Fourier series contains only 
cosine terms. In contrast, if the signal has an odd symmetry, the Fourier series 
contains only sine terms. If a periodic signal has a jump discontinuity, the signal is 
not smooth and requires significant high frequency components to synthesize jumps. 
Consequently, its amplitude spectrum decays slowly with frequency as 1/n. If the 
signal has no jump discontinuities, but its first derivative has a jump discontinuity, 
the signal is smoother, and its amplitude spectrum decays faster as 1/n?. If neither 
the signal nor its first derivative has jump discontinuities, but the second derivative 
has discontinuities, then the signal is even more smooth, and its amplitude spectrum 
decays still faster as 1/n3, and so on. 


A sinusoid can be expressed in terms of exponentials. Therefore, the Fourier se- 
ries of a periodic signal can also be expressed as a sum of exponentials (the exponen- 
tial Fourier series). The exponential form of the Fourier series and the expressions 
for the series coefficients are more compact than those of the trigonometric Fourier 
series. Also, the response of LTIC systems to an exponential input is simpler than 
that for a sinusoidal input. Moreover, the exponential form of representation lends 
itself better to mathematical manipulations than does the trigonometric form. For 
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these reasons, the exponential form of the series is preferred in modern practice in 
the areas of signals and systems. 

The plots of amplitudes and angles of various exponential components of the 
Fourier series as functions of the frequency are the exponential Fourier spectra 
(amplitude and angle spectra) of the signal. Because a sinusoid cos wot can be 
represented as a sum of two exponentials, e/“°* and e~30t, the frequencies in the 
exponential spectra range from ~oo to oo. By definition, the frequency of a signal is 
always a positive quantity. Presence of a spectral component of a negative frequency 
—nwo merely indicates that the Fourier series contains terms of the form e~7™0*. 
The spectra of the trigonometric and exponential Fourier series are closely related, 
and one can be found by the inspection of the other. 

The Fourier series coefficients Cn or Dn may be computed numerically using 
the discrete Fourier transform (DFT), which can be implemented by an efficient 
FFT (fast Fourier transform) algorithm. This method uses No uniform samples of 
f(t) over one period starting at t = 0. 

In Sec. 3.7, we discuss a method of finding the response of an LTIC system to a 
periodic input signal. The periodic input is expressed as an exponential Fourier se- 
ties, which consists of everlasting exponentials of the form e7"°t, We also know that 
response of an LTIC system to an everlasting exponential e9™* is H (jnwg)e3™*. 
The system response is the sum of the system’s responses to all the exponential 
components in the Fourier series for the input. The response is, therefore, also an 
exponential Fourier series. Thus, the response is also a periodic signal of the same 
period as that of the input. 
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Problems 


3.1-1 Derive Equation (3.6) in an alternate way by observing that e=(f—cx) and 
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3.1-2 


3.1-3 


3.1-4 


3.1-5 


fo) x(t) 


fa) (b) 


Fig. P3.1-2 
le? = (f-cx) - (f-cx)=|f]? +-c?|x|?—2cf-x. Hint: Find the value of c to minimize \e|?. 


(a) For the signals f(t) and z(t) depicted in Fig. P3.1-2, find the component of 
the form z(t) contained in f(t). In other words find the optimum value of c in the 
approximation f(t) + ca(t) so that the error signal energy is minimum. 

(b) Find the error signal e(t) and its energy Ee. Show that the error signal is 
orthogonal to x(t), and that Ey = c?E; + Ee. Can you explain this result in terms 
of vectors. 


For the signals f(t) and z(t) shown in Fig. P3.1-2, find the component of the form f(t) 
contained in z(t). In other words, find the optimum value of c in the approximation 
a(t) © cf(t) so that the error signal energy is minimum. What is the error signal 
energy? 


Repeat Prob. 3.1-2 if z(t) is a sinusoid pulse shown in Fig. P3.1-4. 


x(t) 


sin 27t 


Fig. P3.1-4 


If x(t) and y(t) are orthogonal, then show that the energy of the signal x(t) + y(t) is 
identical to the energy of the signal x(t) — y(t) and is given by Es + Ey. Explain this 
result using vector concepts. In general, show that for orthogonal signals a(t) and 
y(t) and for any pair of arbitrary constants cı and co, the energies of ci z(t) + cay(t) 
and cız(t) — coy(¢) are identical, given by c? Es + c3Ey. 


x(t) fi f(D 


sin 2nt 


sin 4rt 
1 


-sin 2n 
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3.2-1 


3.3-1 


3.4-1 


3.4-2 


3.4-3 


3.4-4 


3.4-5 


3.4-6 
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Find the correlation coefficient cn of signal x(t) and each of the four pulses fı(t), fo (t), 
fa(t), and fa(t) depicted in Fig. P3.2-1. Which pair of pulses would you select for a 
binary communication in order to provide maximum margin against noise along the 
transmission path? 


Let 21(t) and z2(t) be two signals orthonormal (that is, with unit energies) over an 
interval from t = tı to tg. Consider a signal f(t) where 


f(t) = crzi(t) + c2r2(t) th <t<te 


This signal can be represented by a two-dimensional vector f(c1, c2). 
(a) Determine the vector representation of the following six signals in the two- 
dimensional vector space: 


(i) filt) = 2z1(t) — xe(t) (iv) fa(t) = 21(t) + 2x2(t) 
(ii) fa(t) = —21(t) + 2ea(t) (v) fs(t) = 201 (t) + z2(t) 
(iii) fa(t) = -z2(t) (vi) felt) = 3z1(t) 


(b) Point out pairs of mutually orthogonal vectors among these six vectors. Verify 
that the pairs of signals corresponding to these orthogonal vectors are also orthogonal. 


(a) Sketch the signal f(t) = t? for all t and find the trigonometric Fourier series y(t) 
to represent f(t) over the interval (—1, 1). Sketch y(t) for all values of t. 


(a) Sketch the signal f(t) = t for all ¢ and find the trigonometric Fourier series p(t) 
to represent f(t) over the interval (—7, r). Sketch y(t) for all values of t. 


For each of the periodic signals shown in Fig. P3.4-3, find the compact trigonometric 
Fourier series and sketch the amplitude and phase spectra. If either the sine or cosine 
terms are absent in the Fourier series, explain why. 


(a) Find the trigonometric Fourier series for z(t) shown in Fig. P3.4-4. 

(b) The signal z(t) is the time-inverted signal y(t) in Fig. 3.7b. Thus, x(t) = y(-t). 
Hence, the Fourier series for z(t) can be obtained by replacing t with —t in the Fourier 
series (Eq. (3.56)] for y(t). Verify that the Fourier series thus obtained is identical to 
that found in part (a). 

(c) Show that, in general, time-inversion of a periodic signal does not affect the 
amplitude spectrum, and the phase spectrum is also unchanged except for the change 
of sign. 


(a) Find the trigonometric Fourier series for the periodic signal z(t) depicted in Fig. 
P3.4-5. 

(b) The signal z(t) can be obtained by time-compressing the signal y(t) in Fig. 3.7b 
by a factor 2. Thus, z(t) = (2t). Hence, the Fourier series for z(t) can be obtained 
by replacing t with 2t in the Fourier series [Eq. (3.56)] for y(t). Verify that the Fourier 
series thus obtained is identical to that found in part (a). 

(c) Show that, in general, time-compression of a periodic signal by a factor a expands 
the Fourier spectra by the same factor a. In other words Co, Cn, and ôn remain un- 
changed, but the fundamental frequency is increased by the factor a, thus expanding 
the spectrum. Similarly time-expansion of a periodic signal by a factor a compresses 
its Fourier spectra by the factor a. 


(a) Find the trigonometric Fourier series for the periodic signal g(t) in Fig. P3.4-6. 
Take advantage of the symmetry. 
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(b) 


Fig. P3.4-5 
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Fig. P3.4-6 


(b) Observe that g(t) is identical to f(t) in Fig. 3.9a left-shifted by 0.5 second. 
Therefore, g(t) = f(t+ 0.5), and the Fourier series for g(t) can be found by replacing 
t with t+ 0.5 in Eq. (3.63) [the Fourier series for f(t)]. Verify that the Fourier series 
thus obtained is identical to that found in part (a). 

(c) Show that, in general, a time shift of T seconds of a periodic signal does not 
affect the amplitude spectrum. However, the phase of the nth harmonic is decreased 
(increased) by nwoT for a delay (advance) of T seconds. 


If the two halves of one period of a periodic signal are of identical shape except that 
the one is the negative of the other, the periodic signal is said to have a half-wave 
symmetry. Ifa periodic signal f(t) with a period To satisfies the half-wave symmetry 
condition, then 


f(t- B) =-#0 


In this case, show that all the even-numbered harmonics vanish, and that the odd- 
numbered harmonic coefficients are given by 


4 To /2 4 To /2 
On = zi f(t)cos nwotdt and bn = al f(t)sin nwot dt 
To o 0 Jo 


Using these results, find the Fourier series for the periodic signals in Fig. P3.4-7. 


(a) 


(b) 


Fig. P3.4-7, 


i> 


Fig. P3.4-8. 
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3.4-8 


3.4-9 


3.4-11 


Over a finite interval, a signal can be represented by more than one trigonometric 
(or exponential) Fourier series. For instance, if we wish to represent f (t) = t over an 
interval 0 < £ < 1 by a Fourier series with fundamental frequency wo = 2, we can 
draw a pulse f(t) = t over the interval 0 < t < 1 and repeat the pulse every m seconds 
so that To = 7 and wo = 2 (Fig. P3.4-8a). If we want the fundamental frequency wo 
to be 4, we repeat the pulse every 1/2 seconds. If we want the series to contain only 
cosine terms with wo = 2, we construct a pulse f(t) = |t| over —1 < t < 1, and repeat 
it every n seconds (Fig. P3.4-8b). The resulting signal is an even function with period 
m. Hence, its Fourier series will have only cosine terms with wo = 2. The resulting 
Fourier series represents f(t) = t over 0 < t < 1 as desired. We do not care what it 
represents outside this interval. 

Represent f(t) = t over 0 < t < 1 by a Fourier series that has 


(a) wo = § and contains all harmonics, but cosine terms only. 
(b) wo = 2 and contains all harmonics, but sine terms only. 
{c) wo = § and contains all harmonics, which are neither exclusively sine nor cosine 
(d) wo = 1 and contains only odd harmonics and cosine terms. 
(e) wo = § and contains only odd harmonics and sine terms. 
(£) wo = 1 and contains only odd harmonics, which are neither exclusively sine nor 
cosine. 
Hint: For parts d, e, and f, you need to use half wave symmetry discussed in Prob. 
3.4-7. Cosine terms imply possible dc component. 

ply p P 


State, with reasons, whether the following signals are periodic or aperiodic. For 
periodic signals, find the period and state which of the harmonics are present in the 
series. 


(a) 3sin t + 2sin 3t 

(b) 2+ 5sin 4t + 4cos 7t 
(c) 2sin 3t + 7 cos mt 
(d) 7cos mt + 5sin 2rt 


(e) 3cos V2t + 5 cos 2t 


(£) sin $ +3cos + 3sin ($ + 30°) 
(g) sin 3t + cos Bt 

(h) (3sin 2t + sin 5t)? 

(i) (sin 2t)° 


FAO] 


Fig. P3.4-10. 


3.4-10 Find the trigonometric Fourier series for f(t) shown in Fig. P3.4-10 over the interval 


[0, 1]. Use wo = 2r. Sketch the Fourier series p(t) for all t. Compute the energy of 
the error signal e(t) if the number of terms in the Fourier series are N for N = 1,2,3 
and 4. 


Hint: Use Eq. (3.40) to compute error energy. 


Walsh functions, which can take on only two amplitude values, form a complete set 
of orthonormal functions and are of great practical importance in digital applications 
because they can be easily generated by logic circuitry and because multiplication 
with these functions can be implemented by simply using a polarity reversing switch. 
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3.4-12 


X(t) 


Fig. P3.4-11. 


Figure P3.4-11 shows the first eight functions in this set. Represent f(t) in Fig. P3.4- 
11 over the interval (0, 1] using a Walsh Fourier series using these 8 basis functions. 
Compute the energy of e(t), the error in the approximation using the first N non-zero 
terms in the series for N = 1, 2, 3 and 4. How does the Walsh series compare with 
the trigonometric series in Prob. 3.4-10 from the viewpoint of the error energy for a 
given N? 


A set of Legendre polynomials P,(t),(n = 0,1,2,3,---) forms a complete set of or- 
thogonal functions over the interval -1 < t < 1. These polynomials are defined 
by 


P,(t) = —(t?-1)" n=0,1,2,--- 


Thus 


Po(t) =l, 
Pa(t) = 5 (30-1), Plt) = 36-3) ete. 


Pi(t)=t 
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3.5-1 


3.5-2 


3.5-3 


3.5-4 


Fig. P3.4-12. 


Legendre polynomials are orthogonal. Reader may verify that 


1 aa a = 
f paora { EA 
-1 0 mEn 


(a) Represent f(t) in Fig. P3.4-12a by the Legendre Fourier series over the interval 
—1<+t< 1. Compute only first two nonzero coefficients of the series. Compute the 
energy of e(t), the error for the one and two (non-zero) term approximations. 

(b) Represent f(t) in Fig. P3.4-12b using the Legendre Fourier series. Compute the 
coefficients of the series for the first two non-zero terms. 

Hint: Although the series representation is valid only over —1 < t < 1, it can be 
extended to any region by suitable time scaling. 


For each of the periodic signals in Fig. P3.4-3, find the exponential Fourier series and 
sketch the corresponding spectra. 


The trigonometric Fourier series of a certain periodic signal is given by 


f(t) =3+ V3cos 2t + sin 2t + sin 3t — 3 cos (5t + 3) 


(a) Sketch the trigonometric Fourier spectra. 

(b) By inspection of the spectra in part a, sketch the exponential Fourier series 
spectra. 

(c) By inspection of the spectra in part b, write the exponential Fourier series for 
F(t). 

Hint: To express the Fourier series in compact form, combine the sine and cosine 
terms of the same frequency. Moreover, all terms must appear in the cosine form 
with positive amplitudes. This can always be done by suitably adjusting the phase. 


The exponential Fourier series of a certain periodic function is given as 


f(t) = (2+ j2)e7** + 720-7" +. 3 — j2e3* + (2 j2)" 
(a) Sketch the exponential Fourier spectra. 
(b) By inspection of the spectra in part a, sketch the trigonometric Fourier spectra 
for f(t). 
(c) Find the compact trigonometric Fourier series from these spectra. 
(d) Find the signal bandwidth. 


If a periodic signal f(t) is expressed as an exponential Fourier series 


Hl) = > Drei" 


n=—0co 


(a) Show that the exponential Fourier series for f(t) = f (t — T) is given by 


ft) = So baer 


n=—-ocoO 
in which 
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|Dn| =|Dn} and Ôn = ¿Dn —nwoT 


This result shows that time shifting of a periodic signal by T seconds 
merely changes the phase spectrum by nwoT. The amplitude spectrum is unchanged. 
(b) Show that the exponential Fourier series for f(t) = f(at) is given by 


fos} 
fie XO pe 
n=—0O 
This result shows that time compression of a periodic signal by a factor a expands its 


Fourier spectra by the same factor a. Similarly, time expansion of a periodic signal 
by a factor a compresses its Fourier spectra by the factor a. 


(a) The Fourier series for the periodic signal in Fig. 3.10a is given in Exercise E3.6. 
Verify Parseval’s theorem for this series, given that 


5 ix 
nt 90 
n=1 


(b) If f(t) is approximated by the first N terms in this series, find N so that the 
power of the error signal is less than 1% of Py. 


(a) The Fourier series for the periodic signal in Fig. 3.10b is given in Exercise E3.6. 
Verify Parseval’s theorem for this series, given that 


ee 


(b) If f(t) is approximated by the first N terms in this series, find N so that the 
power of the error signal is less than 10% of Py. 


The signal f(t) in Fig. 3.18 is approximated by the first 2N + 1 terms (from n = —N 
to N) in its exponential Fourier series given in Exercise E3.10. Determine the value 
of N if this (2N + 1)-term Fourier series power is to be no less than 99.75% of the 
power of f(t). 


Find the response of an LTIC system with transfer function 


s 


H(s) = s2 +2s+3 


to the periodic input shown in Fig. 3.7b. 


j: 


Continuous-Time Signal Analysis: 
The Fourier Transform 


In Chapter 3, we succeeded in representing periodic signals as a sum of (ever- 
lasting) sinusoids or exponentials. In this chapter we extend this spectral represen- 
tation to aperiodic signals. 


4.1 Aperiodic Signal Representation by Fourier Integral 


Applying a limiting process, we now show that an aperiodic signal can be 
expressed as a continuous sum (integral) of everlasting exponentials. To represent an 
aperiodic signal f(t) such as the one depicted in Fig. 4.1a by everlasting exponential 
signals, let us construct a new periodic signal f7,(t) formed by repeating the signal 
f(t) at intervals of To seconds, as illustrated in Fig. 4.1b, The period To is made 
long enough to avoid overlap between the repeating pulses. The periodic signal 
fr, (t) can be represented by an exponential Fourier series. If we let Ty > 00, the 
pulses in the periodic signal repeat after an infinite interval and, therefore 


lim, frl) = F(t) 


Thus, the Fourier series representing f7,(t) will also represent f(t) in the limit 
To — oo. The exponential Fourier series for fr, (t) is given by 


co 

ft (t) = D Dyeirot (4.1) 

n=—-co 

where 
1 fto/2 
Dnr = Ta R fr, (t)e It dt (4.2a) 
=t0 

2 

and TS T (4.2b) 
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f(t) 
{a) 


To 2 oe To os 


Fig. 4.1 Construction of a periodic signal by periodic extension of f(t). 


Observe that integrating fr,(t) over (-2, I) is the same as integrating f(t) over 
(—00,00). Therefore, Eq. (4.2a) can be expressed as 


Dr = z) f(t)e iot dt (4.2c) 
To J- 


It is interesting to see how the nature of the spectrum changes as To increases. 
To understand this fascinating behavior, let us define F (w), a continuous function 
of w, as 


co 
F(w) = J f(t)e I" at (4.3) 
—oo 
A glance at Eqs. (4.2c) and (4.3) shows that 
Dn = =F (nw) (4.4) 
To 


This means that the Fourier coefficients Dn are (1/Tg) times the samples of F(w) 
uniformly spaced at intervals of wo, as depicted in Fig. 4.2a.t Therefore, (1/To)F (w) 
is the envelope for the coefficients Dn. We now let Tp — oo by doubling To repeat- 
edly. Doubling To halves the fundamental frequency wo [Eq. (4.2b)], so that there 
are now twice as many components (samples) in the spectrum. However, by dou- 
bling To, the envelope (1/To) F(w) is halved, as shown in Fig. 4.2b. If we continue 
this process of doubling To repeatedly, the spectrum progressively becomes denser 
while its magnitude becomes smaller. Note, however, that the relative shape of 
the envelope remains the same [proportional to F(w) in Eq. (4.3)]. In the limit as 
To — œ, wo — 0 and Dn — 0. This result means the spectrum is so dense that 
the spectral components are spaced at zero (infinitesimal) intervals. At the same 
time, the amplitude of each component is zero (infinitesimal). We have nothing of 
everything, yet we have something! This paradox sounds like Alice in Wonderland, 


{For the sake of simplicity, we assume Dn, and therefore F(w), in Fig. 4.2, to be real. The 
argument, however, is also valid for complex Dn [or F(w)}. 
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Envelope 


F dre 


Envelope 
a 
7, F(@) 


Fig. 4.2 Change in the Fourier spectrum when the period To in Fig. 4.1 is doubled. 


but as we shall see, these are the classic characteristics of a very familiar phe- 
nomenon.t 
Substitution of Eq. (4.4) in Eq. (4.1) yields 


oO 


fnd = Sy EEO oinor (4.5) 


n=—-0oO 


As To — œœ, wo becomes infinitesimal (wo — 0). Hence, we shall replace wo by a 
more appropriate notation, Aw. In terms of this new notation, Eq. (4.2b) becomes 


Rees ct 
To 
and Eq. (4.5) becomes 
 [F(nAw)A 
fr(t)= >> [fesse a =] etna (4.6a) 


Equation (4.6a) shows that f7,(t) can be expressed as a sum of everlasting expo- 
nentials of frequencies 0, tAw, +2Aw,+3Aw,.... (the Fourier series). The amount 
of the component of frequency nAw is [F(nAw)Aw]/27. In the limit as To —> 
oo, Aw > 0 and fr, (t) — f(t). Therefore 


co 


1 : 
=z- =N (jnAw)t 
f(t) ymi fr (t) aim, oe 2 F(nAw)e Aw (4.6b) 


The sum on the right-hand side of Eq. (4.6b) can be viewed as the area under the 
function F(w)e*, as illustrated in Fig. 4.3. Therefore 


1 f° ; 

ft) = z F(w)et tdw (4.7) 
27 J- 

The integral on the right hand side is called the Fourier integral. We have now 


succeeded in representing an aperiodic signal f(t) by a Fourier integral (rather 


fIf nothing else, the reader now has an irrefutable proof of the proposition that 0% ownership of 
everything is better than 100% ownership of nothing. 
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than a Fourier series).{ This integral is basically a Fourier series (in the limit) 
with fundamental frequency Aw — 0, as seen from Eq. (4.6). The amount of the 
exponential e/"4“* is F(nAw)Aw/2r. Thus, the function F(w) given by Eq. (4.3) 
acts as a spectral function. 


area = F(ndw)e!"*"' aw 


Fig. 4.3 The Fourier series becomes the Fourier integral in the limit as Tp — oo. 


We call F (w) the direct Fourier transform of f(t), and f(t) the inverse Fourier 
transform of F(w). The same information is conveyed by the statement that f(t) 
and F(w) are a Fourier transform pair. Symbolically, this statement is expressed as 


F(w) = F{f()] and f(t) = F7 [F (w)] 
or 
f(t) = Fhv) 
To recapitulate, 
F(w) = f j f(t)e I" dt (4.8a) 
and 
f(t) = = [Flue a (4.8b) 


It is helpful to keep in mind that the Fourier integral in Eq. (4.8b) is of the 
nature of a Fourier series with fundamental frequency Aw approaching zero [Eq. 
(4.6b)|. Therefore, most of the discussion and properties of Fourier series apply to 
the Fourier transform as well. We can plot the spectrum F(w) as a function of w. 
Since F(w) is complex, we have both amplitude and angle (or phase) spectra 


F(w) = |F (v) rO (4.9) 


in which |F(w)| is the amplitude and ZF (w) is the angle (or phase) of F (w). Ac- 
cording to Eq. (4.8a), 


F(-w) = L f(t)? dt 


From this equation and Eq. (4.8a), it follows that if f(t) is a real function of t, then 
F(w) and F(—w) are complex conjugates. Therefore 


+This derivation should not be considered as a rigorous proof of Eq. (4.7). The situation is not as 
simple as we have made it appear.! 
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[F(-w)| = |F(w)| (4.10a) 
LF(-w) = -LF (w) (4.10b) 


Thus, for real f(t), the amplitude spectrum |F(w)| is an even function, and the 
phase spectrum /F(w) is an odd function of w. This property the (conjugate 
symmetry property) is valid only for real f(t). These results were derived earlier 
for the Fourier spectrum of a periodic signal [Eq. (3.77)] and should come as no 
surprise. The transform F(w) is the frequency-domain specification of f (t). 


Va lF@)| 


`~. LFW) 
1 a 
2 
Fig. 4.4 e~**u(t) and its Fourier spectra. 
E Example 4.1 
Find the Fourier transform of e~*u(t). 
By definition (Eq. (4.8a)], 
o0 oo oo 
F(w) = e “*u(t)e 1 dt = (Otsu yt dt = pasa eT (atsu)t 
ne o a+ jw o 


But je~%“*| = 1. Therefore, as t — 00, e (atiu)t — ette iet — 0 if a > 0. Therefore 


F(w) = a>0 (4.11a) 


a+ jw 
Expressing a + jw in the polar form as Va? +w? ef tan) (3) we obtain 


Fw) = E = eTitan™! (2) (4.11b) 
Therefore 
= 1 -tn i (2 
IF) = as and LF(w) = -tan (=) (4.12) 


The amplitude spectrum |F(w)| and the phase spectrum ZF (w) are depicted in Fig. 4.4b. 
Observe that |F(w)! is an even function of w, and 4F(w) is an odd function of w, as 
expected. W 


Existence of the Fourier Transform 

In Example 4.1 we observed that when a < 0, the Fourier integral for e~*u(t) 
does not converge. Hence, the Fourier transform for e~*tu(t) does not exist if 
a < 0 (growing exponential). Clearly, not all signals are Fourier-transformable. The 
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existence of the Fourier transform is assured for any f(t) satisfying the Dirichlet 
conditions mentioned on p. 194-195. The first of these conditions is} 


m |f(t)|dt < œ (4.13) 


=00 


Because |e7“t| = 1, from Eq. (4.8a), we obtain 


HOE J T Flat 


This inequality shows that the existence of the Fourier transform is assured if condi- 
tion (4.13) is satisfied. Otherwise, there is no guarantee. We have seen in Example 
4.1 that the Fourier transform does not exist for an exponentially growing signal 
{which violates this condition). Although this condition is sufficient, it is not neces- 
sary for the existence of the Fourier transform of a signal. For example, the signal 
(sin at)/t violates condition (4.13), but does have a Fourier transform. Any signal 
that can be generated in practice satisfies the Dirichlet conditions and therefore has 
a Fourier transform. Thus, the physical existence of a signal is a sufficient condition 
for the existence of its transform. 


Linearity of the Fourier Transform 
The Fourier transform is linear; that is, if 


filt) = Fi(w) and fo(t) = Fa(w) 
then 


aifi(t) + agfo(t) => a1 F\(w) + a2F2(w) (4.14) 


The proof is trivial and follows directly from Eq. (4.8a). This result can be extended 
to any finite number of terms. 


4.1-1 Physical Appreciation of the Fourier Transform 


In understanding any aspect of the Fourier transform, we should remember that 
Fourier representation is a way of expressing a signal in terms of everlasting sinusoids 
(or exponentials). The Fourier spectrum of a signal indicates the relative amplitudes 
and phases of the sinusoids that are required to synthesize that signal. A periodic 
signal Fourier spectrum has finite amplitudes and exists at discrete frequencies 
(wo and its multiples). Such a spectrum is easy to visualize, but the spectrum of 
an aperiodic signal is not easy to visualize because it has a continuous spectrum. 
The continuous spectrum concept can be appreciated by considering an analogous, 
more tangible phenomenon. One familiar example of a continuous distribution is 
the loading of a beam. Consider a beam loaded with weights D1, D2, D3,...,Dn 
units at the uniformly spaced points £1, £2,..., n, as shown in Fig. 4.5a. The total 
load Wr on the beam is given by the sum of these loads at each of the n points: 


{The remaining Dirichlet conditions are as follows: in any finite interval, f(t) may have only a 
finite number of maxima and minima and a finite number of finite discontinuities. When these 
conditions are satisfied, the Fourier integral on the right-hand side of Eq. (4.8b) converges to f(t) 
at all points where f(t) is continuous and converges to the average of the right-hand and left-hand 
limits of f(t) at points where f(t) is discontinuous. 
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Fig. 4.5 Analogy for Fourier transform. 


n 
Wr= 5 Di 
i=l 


Consider now the case of a continuously loaded beam, as depicted in Fig. 4.5b. In 
this case, although there appears to be a load at every point, the load at any one 
point is zero. This does not mean that there is no load on the beam. A meaningful 
measure of load in this situation is not the load at a point, but rather the loading 
density per unit length at that point. Let F(x) be the loading density per unit 
length of beam. It then follows that the load over a beam length Ax (Az — 0), at 
some point x, is F(x)Az. To find the total load on the beam, we divide the beam 
into segments of interval Az (Az — 0). The load over the nth such segment of 
length Az is F(nAz)Az. The total load Wr is given by 


En 
Wr = din, 2O EAs) Az 
1 


In the case of discrete loading (Fig. 4.5a), the load exists only at the n discrete 
points. At other points there is no load. On the other hand, in the continuously 
loaded case, the load exists at every point, but at any specific point x, the load 
is zero. The load over a small interval Ax, however, is [F(nAzx)| Ax (Fig. 4.5b). 
Thus, even though the load at a point x is zero, the relative load at that point is 
F(z). 

An exactly analogous situation exists in the case of a signal spectrum. When 
f(t) is periodic, the spectrum is discrete, and f (t) can be expressed as a sum of 
discrete exponentials with finite amplitudes: 


f(t) = $ Dei" 


For an aperiodic signal, the spectrum becomes continuous; that is, the spectrum 
exists for every value of w, but the amplitude of each component in the spectrum 
is zero. The meaningful measure here is not the amplitude of a component of some 
frequency but the spectral density per unit bandwidth. From Eq. (4.6b) it is clear 
that f(t) is synthesized by adding exponentials of the form e/"4”, in which the 
contribution by any one exponential component is zero. But the contribution by 
exponentials in an infinitesimal band Aw located at w = nAw is TF (nAw)Aw, 
and the addition of all these components yields f(t) in the integral form: 
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i< if” 

t)= lim — So F(nAw)e@¥Aw = — jut 4.15 

f(t) slim. a e (nAw)e Aw = gue dw (4.15) 


The contribution by components within a band dw is TF) dw = F(w) dF, where 
dF is the bandwidth in hertz. Clearly, F (w) is the spectral density per unit band- 
width (in hertz). It also follows that even if the amplitude of any one component is 
zero, the relative amount of a component of frequency w is F(w). Although F(w) is 
a spectral density, in practice it is customarily called the spectrum of f(t) rather 
than the spectral density of f(t). Deferring to this convention, we shall call F(w) 
the Fourier spectrum (or Fourier transform) of f(t). 


fr) 


a te b 
Fig. 4.6 Marvel of the Fourier transform. 


A Marvelous Balancing Act 


An important point to remember here is that f(t) is represented (or synthe- 
sized) by exponentials or sinusoids that are everlasting (not causal). Such conceptu- 
alization leads to a rather fascinating picture when we try to visualize the synthesis 
of a timelimited pulse signal f(t) (Fig. 4.6) by the sinusoidal components in its 
Fourier spectrum. The signal f(t) exists only over an interval (a, b) and is zero 
outside this interval. The spectrum of f (t) contains an infinite number of exponen- 
tials (or sinusoids) which start at t = —oo and continue forever. The amplitudes 
and phases of these components are such that they add up exactly to f(t) over the 
finite interval (a, b) and add up to zero everywhere outside this interval. Juggling 
with amplitudes and phases of an infinite number of components to achieve such 
a perfect and delicate balance boggles the human imagination. Yet the Fourier 
transform accomplishes it routinely, without much thinking on our part. Indeed, 
we become so involved in mathematical manipulations that we fail to notice this 
marvel. 


A Word About Notation 
In Chapter 2 [Eq. (2.48)], we defined the system transfer function H (s) as 


[es] 
H(s) = f A(t)e* dt (4.16) 
—00 
Setting s = jw in this equation yields 
iea] 
H (jw) -f h(tje tdt (4.17) 
=00 


The right-hand side is the Fourier transform of h(t), and according to our notation 
introduced in Eq. (4.3) this is H (w), whereas the same entity is denoted by H (jw) 
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in the notation introduced in Chapter 2. Thus, to be consistent with the previous 
notation, we should have denoted the Fourier transform by F (jw) rather than F (w) 
in Eq. (4.3). In fact, the notation F(jw) for the Fourier transform is often used 
in the literature. It is, however, a bit clumsy and does not lend itself so easily 
to manipulation as the notation F(w). For this reason we shall continue with the 
dual notation, while remembering that both F(w) and F(jw) represent the same 
entity. This fact is particularly important when we discuss the Laplace transform 
and filtering in the future, and should be kept in mind throughout the rest of the 
book. In the same way, we must remember that H(w) and H(jw) represent the 
same entity. 


4.1-2 LTIC System Response Using the Fourier Transform 


We wanted to represent a signal f(t) as a sum of (everlasting) exponentials so 
that we could find a system response to f(t) as a sum of the system’s responses 
to the exponential components of f(t). Consider an asymptotically stable LTIC 
system with transfer function H(s). The response of this system to everlasting 
exponential e*t is H(w)e!*. Such an input-output pair will be denoted by the 
directed arrow representation as 


et — H (we? 
Therefore 
el(nQu)t — H (ndwe Aoh 


[am] eindu)t ay Ha ei(ndu)e 
2r 27 
Using the linearity property 


co co 
TA eS eindu)t s lim [oe eindu)t 
Aw—0 Qn Aw—0 2n 


n=-00 n=-00 


input f(t) output y(t) 


The left-hand side is the input f(t) [see Eqs. (4.6a) and (4.6b)], and the right-hand 
side is the response y(t). Thus ` 


1 . 
‘Si j(nQw)t 
y(t) oe aim 5 F(nAw)H (nAw)e Aw 
n=—00 
1 co 
=— F(w)H (wei? dw 
27 J= 
yA Bs ; 
= Y (wed? dw (4.18) 
—00 


where Y (w), the Fourier transform of y(t), is given byt 


{The relationship (4.19) applies only to the asymptotically stable systems. The reason is that 
when s = jw, the integral on the right-hand side of Eq. (2.48) does not converge for unstable 
systems. Moreover, even for marginally stable systems, that integral does not converges in the 
ordinary sense, and H(jw) [or H(w)] cannot be obtained by replacing s in H(s) with jw. As shown 
in Eq. (4.44b), Eq. (4.19) can be applied to marginally stable systems provided H(w) is interpreted 
as the Fourier transform of h(t) rather than as H(s) with s replaced by jw. 
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Y (w) = F(w)H(w) (4.19) 


In conclusion, we showed that for an LTIC system with transfer function H (s), if 
the input and the output are f(t) and y(t), respectively, and if 


f(t) = Fi) y(t) = YW) 
then for asymptotically stable systems 
Y (w) = F(w) HW) 


We shall derive this result again later in a more formal way. 

The procedure of the frequency-domain method is identical to that of the time- 
domain method. In the time-domain case we express the input f(t) as a sum of 
its impulse components; in the frequency-domain case, the input is expressed as 
a sum of everlasting exponentials (or sinusoids). In the former case, the response 
y(t) obtained by summing the system’s responses to impulse components results 
in the convolution integral; in the latter case, the response obtained by summing 
the system’s response to everlasting exponential components results in the Fourier 
integral. These ideas can be expressed mathematically as follows: 


1 For the time-domain case 


slt) => h(t) the impulse response of the system is h(t) 


fo] 
Ft) = | f(z)6(t — 2) dz expresses f(t) as a sum of impulse components 
-00 


and 


[ea] 
y(t) = J f(x)h(t -x)dz expresses y(t) as a sum of responses to impulse components 
—00 


2 For the frequency-domain case 


et => H(w)et”t the system response to e/“* is H(w)eI“* 


1° ; 
ft) = a J F (wett dw shows f(t) as a sum of everlasting exponential components 
T 


00 


and 


1° j 
y(t) = = f F(w)H (w)et“* dw y(t) is a sum of responses to exponential components 
7 —oO 


The frequency-domain view sees a system in terms of its frequency response 
(system response to various sinusoidal components). It views a signal as a sum of 
various sinusoidal components. Transmission of a signal through a (linear) system 
is viewed as transmission of various sinusoidal components of the signal through the 
system. 
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Fig. 4.7 A gate pulse. 


4.2 Transforms of Some Useful Functions 


For convenience, we now introduce a compact notation for some useful functions 
such as gate, triangle, and interpolation functions. 
Unit Gate Function 


We define a unit gate function rect (x) as a gate pulse of unit height and unit 
width, centered at the origin, as illustrated in Fig. 4.7a:+ 


0 lz] > 3 
rect (x) = 3 |z| = 3 (4.20) 
1 |z| < 3 


The gate pulse in Fig. 4.7b is the unit gate pulse rect (x) expanded by a factor 
T and therefore can be expressed as rect (=) (see Sec. 1.3-2). Observe that r, the 
denominator of the argument of rect(£), indicates the width of the pulse. 


Unit Triangle Function 


We define a unit triangle function A(z) as a triangular pulse of unit height and 
unit width, centered at the origin, as shown in Fig. 4.8a 


=f? HES 
A(z) = ie zje] ae i (4.21) 


The pulse in Fig. 4.8b is A(Z). Observe that here, as for the gate pulse, the 
denominator r of the argument of A(?) indicates the pulse width. 


mie 


Fig. 4.8 A triangle pulse. 


tat x = 0, we require rect (x) = 0.5, because the inverse Fourier transform of a discontinuous 
signal converges to the mean of its two values at the discontinuity. 
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Fig. 4.9 A sinc pulse. 


Interpolation Function sinc (x) 


The function sin z/7 is the “sine over argument” function denoted by sinc (x).t 
This function plays an important role in signal processing. It is also known as the 
filtering or interpolating function. We define 


sin x 


(4.22) 


sinc (x) = 
T 


Inspection of Eq. (4.22) shows that 
1. sinc (x) is an even function of z. 


2. sinc (x) = 0 when sin z = 0 except at z = 0, where it appears indeterminate. 
This means that sincz = 0 for z = +7,+27,£37,... 
3. Using L’Hépital’s rule, we find sinc(0)=1. 


4. sinc (x) is the product of an oscillating signal sin z (of period 27) and a mono- 
tonically decreasing function 1/z . Therefore, sinc (x) exhibits sinusoidal os- 
cillations of period 27, with amplitude decreasing continuously as 1/z. 


Figure 4.9a shows sinc (x). Observe that sinc (x) = 0 for values of z that are 
positive and negative integral multiples of 7. Figure 4.9b shows sinc (32). The 


tsinc (£) is also denoted by Sa (x) in the literature. Some authors define sinc (x) as 
sin mT 


sinc (x) = = 
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argument 3g = z when w = TE, Therefore, the first zero of this function occurs at 


= ix 
w=. 


ô Exercise E4.1 
Sketch: (a) rect ($) (b) A(#3) (c) sinc (33%) (d) sinc ()rect (4). Vv 


E Example 4.2 
Find the Fourier transform of f(t) = rect (£) (Fig. 4.10a). 


F(w) =f rect (=) e` tdt 
= y 


co 


Since rect (=) = 1 for |t| < $, and since it is zero for |t| > a 


{2 ; 
F(w) = f e i* dt 


—7/2 
me 1 (e7572 _ gir /2) = 2sin ($5) 

jw w 
= peaked = T sinc (+) 

(4) 2 
Therefore 
t r WT 
rect (=) <=> 7 sinc (+) (4.23) 


Recall that sinc (z) = 0 when z = tnz. Hence, sinc (#7) = 0 when 4 = tnr; that 
is, when w = +E, (n = 1,2,3,...), as depicted in Fig. 4.10b. The Fourier transform 
F(w) shown in Fig. 4.10b exhibits positive and negative values. A negative amplitude can 
be considered as a positive amplitude with a phase of — or 7. We use this observation 
to plot the amplitude spectrum |F(w)| = {sinc (44)| (Fig. 4.10c) and the phase spectrum 
LF(w) (Fig. 4.10d). The phase spectrum, which is required to be an odd function of w, 
may be drawn in several other ways because a negative sign can be accounted for by a 


phase of nr, where n is any odd integer. All such representations are equivalent. W 


f(t) 


via 


Fig. 4.10 A gate pulse f(z), its Fourier spectrum F(w), amplitude spectrum |F(w)|, and 
phase spectrum /F(w). 
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Fig. 4.11 Unit impulse and its Fourier spectrum. 


Bandwidth of rect (£) 


The spectrum F(w) in Fig. 4.10 peaks at w = 0 and decays at higher frequen- 
cies. Therefore, rect (4) is a lowpass signal with most of the signal energy in lower 
frequency components. Strictly speaking, because the spectrum extends from 0 to 
oo, the bandwidth is oo. However, much of the spectrum is concentrated within the 
first lobe (from w = 0 tow = 21), Therefore, a rough estimate of the bandwidth of 
a rectangular pulse of width 7 seconds is 2z rad/s, or 1 Hz.} Note the reciprocal 
relationship of the pulse width with its bandwidth. We shall observe later that this 


result is true in general. 


@ Example 4.3 
Find the Fourier transform of the unit impulse 6(t). 
Using the sampling property of the impulse [Eq. (1.24)], we obtain 


F(6(t)| = 1 j 6(t)e tdt =1 (4.24a) 
or > 
6(t) => 1 (4.24b) 


Figure 4.11 shows 6(t) and its spectrum. W 
a Example 4.4 


Find the inverse Fourier transform of 6(w). 
On the basis of Eq. (4.8b) and the sampling property of the impulse function, 


Few = == i ” (wt dw = = 


Therefore = 
1 
= <= Sw) (4.25a) 
or 2r 
1 = 276(w) (4.25b) 


This result shows that the spectrum of a constant signal f(t) = 1 is an impulse 276(w), as 
illustrated in Fig. 4.12. 

The result [Eq. (4.25b)} also could have been anticipated on qualitative grounds. 
Recall that the Fourier transform of f(t) is a spectral representation of f(t) in terms of 
everlasting exponential components of the form e?“*, Now, to represent a constant signal 


{To compute bandwidth, we must consider the spectrum only for positive values of w. See discus- 
sion on p. 212. 
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F (@) =278 (@) 


Fig. 4.12 A constant (dc) signal and its Fourier spectrum. 


f(t) = 1, we need a single everlasting exponential e*t with w = 0.t This results in a 
spectrum at a single frequency w = 0. Another way of looking at the situation is that 
f(t) = 1 is a de signal which has a single frequency w = 0 (dc). W 


If an impulse at w = 0 is a spectrum of a de signal, what does an impulse at 
w = wo represent? We shall answer this question in the next example. 


E Example 4.5 
Find the inverse Fourier transform of 5(w — wo). 
Using the sampling property of the impulse function, we obtain 


FoN6(w — wo)] = =/ 5(w — woje“? dw = =e 
—c 


Therefore 


1 A 
ae => ô(w ~ wo) 
or 
etot e 2rô(w — wo) (4.26a) 


This result shows that the spectrum of an everlasting exponential e7“°* is a single impulse 
at w = wo. We reach the same conclusion by qualitative reasoning. To represent the 
everlasting exponential e7“°*, we need a single everlasting exponential e7“* with w = wo. 
Therefore, the spectrum consists of a single component at frequency w = wo. 

From Eq. (4.26a) it follows that 


e FOF > IS (w + wo) (4.26b) 


a 
a Example 4.6 


Find the Fourier transforms of the everlasting sinusoid cos wot. 
Recall the Euler formula 


Eny . 
cos wot = en 4+ e Jot) 


{The constant multiplier 27 in the spectrum [F(w) = 276(w)] may be a bit puzzling. Since 
1 = efvt with w = 0, it appears that the Fourier transform of f(t) = 1 should be an impulse of 
strength unity rather than 27. Recall, however, that in the Fourier transform f(t) is synthesized 
not by exponentials of amplitude F(ndw)Aw, but of amplitude 1/27 times F(nAw)Aw, as seen 


from Eq. (4.6b). Had we used variable F (hertz) instead of w, the spectrum would have been a 
unit impulse. 
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f(t) COS Wp f 


Fig. 4.13 A cosine signal and its Fourier spectrum. 
Adding Eqs. (4.26a) and (4.26b), and using the above formula, we obtain 


cos wot ==> T[ó(w + wo) + 5(w — wo)] (4.27) 


The spectrum of cos wot consists of two impulses at wo and — wo, as shown in Fig. 4.13. 
The result also follows from qualitative reasoning. An everlasting sinusoid cos wot can 
be synthesized by two everlasting exponentials, e?“°' and e~7“°t. Therefore the Fourier 
spectrum consists of only two components of frequencies wọ and —wo. W 
| Example 4.7 

Find the Fourier transform of the unit step function u(t). 


Trying to find the Fourier transform of u(t) by direct integration leads to an indeter- 
minate result, because 


i ; Roy xy oG 
U(w) = / u(t)e 2" dt = I eTit dt = eint 
= 0 Jw 


oo 


foo) 


0 


Observe that the upper limit of e~7“* as t oo yields an indeterminate answer. So we 
approach this problem by considering u(t) as a decaying exponential e~**u(t) in the limit 
as a — 0 (Fig. 4.14a). Thus 


u(t) = lim e “u(t) 


and 
U(w) = li at =li l 
(w) lim Fle “ult)} lim Parr (4.28a) 
Expressing the right-hand side in terms of its real and imaginary parts yields 
; a . W 
Uw) = lim [at aa vee 


= lim | = J+ 
~ a0 La? +w? jw 


The function a/(a? + w?) has interesting properties. First, the area under this function 
(Fig. 4.14b) is r regardless of the value of a 


oo 
a -1 w|” 
age te = tan | =n 
oo & +w a|~co 


Second, when a — 0, this function approaches zero for all w # 0, and all its area (r) 
is concentrated at a single point w = 0. Clearly, as a — 0, this function approaches an 
impulse of strength m.t Thus 


U(w) = rô(w) + 5 (4.29) 


{The second term on the right-hand side of Eq. (4.28b), being an odd function of w, has zero area 
regardless of the value of a. As a — 0, the second term approaches 1/jw. 
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Mena u(t) 


Fig. 4.14 Derivation of the Fourier transform of the step function. 


Note that u(t) is not a “true” dc signal because it is not constant over the interval —oo 
to oo. To synthesize a “true” dc, we require only one everlasting exponential with w = 0 
(impulse at w = 0). The signal u(t) has a jump discontinuity at t = 0. It is impossible 
to synthesize such a signal with a single everlasting exponential e’“*. To synthesize this 
signal from everlasting exponentials, we need, in addition to an impulse at w = 0, all 
frequency components, as indicated by the term 1/jw in Eq. (4.29). B 


A Exercise E4.2 
Show that the Fourier transform of the sign function sgn(t) depicted in Fig. 4.15a is 2/jw. 
Hint: Note that sgn(t) shifted vertically by 1 yields 2u(t) Yy. 


A Exercise E4.3 
Show that the inverse Fourier transform of F (w) illustrated in Fig. 4.15b is f(t) = £2 sinc (wot). 
Sketch f(t). Vv. 


A Exercise E4.4 i i 
Show that cos (wot + 8) <=> m[5(w + wo)e™i? + 5(w — wo)e?9]. 


Hint: cos (wot + 0) = d{efwot+®) 4 e7ilwot+8)] q 


sgn (¢) 


Fig. 4.15 


4.3 Some properties of the Fourier Transform 


We now study some of the important properties of the Fourier transform and 
their implications as well as applications. Before embarking on this study, we shall 
explain an important and pervasive aspect of the Fourier transform: the time- 
frequency duality. 
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Table 4.1 
A Short Table of Fourier Transforms 


Fe 


f(t) F(w) 
1 
1 e““u(t) n a>0 
a+ jw 
1 
2 eMu(—t) n a>0 
a— jw 
z 2a 
gts a? +w? a>0 
4 te u(t) eo ae a>0 
(a + jw)? 
t n! A 
Nara S 
5 t™e u(t) Care 7 
6 6(t) 1 
7T 1l Qn 6(w) 
8 ej»ot 2n6(w — wo) 
9 cos wot m(6(w — wo) + 6(w + wo)| 
10 sin wot jr[6(w + wo) — 6(w — wo)] 
1 u(t) TE e 
12 sgnt o 
ae eop AU §[6(w ~ wo) + êlo +40)] + zia 
14 sin wot u(t) gel — wo) — 6(w + wo)] + EN 
15 e7 sin wot u(t) UHT a>0 
16 e~% cos wot u(t) na a>0 
17 rect (Ż) r sinc (47) 
18 “sinc (Wt) rect (547) 
19 A(z) Z sinc? (#5) 
20 Æ sinc? (4) A (35) 
o0 oo 
21. JO êlt-nT) wo D> 5(w — nwo) wo = 4 
RS 00. n=—00 
to ee oVine- 7/2 
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[ree at 
f@) Fœ) 


1 f Fæ) do 


Fig. 4.16 A near symmetry between the direct and the inverse Fourier transforms. 


4.3-1 Symmetry of Direct and inverse Transform Operations: 
Time-Frequency Duality 


Equations (4.8) show an interesting fact: the direct and the inverse transform 
operations are remarkably similar. These operations, required to go from f(t) to 
F(w) and then from F (w) to f(t), are depicted graphically in Fig. 4.16. There are 
only two minor differences in these operations: the factor 27 appears only in the 
inverse operator, and the exponential indices in the two operations have opposite 
signs. Otherwise the two operations are symmetrical.t This observation has far- 
reaching consequences in the study of the Fourier transform. It is the basis of the 
so-called duality of time and frequency. The duality principle may be compared with 
a photograph and its negative. A photograph can be obtained from its negative, and 
by using an identical procedure, the negative can be obtained from the photograph. 
For any result or relationship between f(t) and F(w), there exists a dual result or 
relationship, obtained by interchanging the roles of f(t) and F(w) in the original 
result (along with some minor modifications arising because of the factor 27 and 
a sign change). For example, the time-shifting property, to be proved later, states 
that if f(t) <> F(w), then 


f(t- to) <=> F(w)e* (4.30a) 
The dual of this property (the frequency-shifting property) states that 


{Of the two differences, the former can be eliminated by change of variable from w to F (in hertz). 
In this case 


w= WF and dw = 2r dF 


Therefore, the direct and the inverse transforms are given by 


oo oo 
F(QnF) = Í f(t)e i?" T tdt and f= / Fn Fel?" 7 taF 
=o -00 
This leaves only one significant difference, that of sign change in the exponential index. Otherwise 
the two operations are symmetrical. 
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fte <=> F(w — wo) (4.30b) 


Observe the role reversal of time and frequency in these two equations (with the 
minor difference of the sign change in the exponential index). The value of this 
principle lies in the fact that whenever we derive any result, we can be sure that 
it has a dual. This possibility can give valuable insights about many unsuspected 
properties or results in signal processing. 

The properties of the Fourier transform are useful not only in deriving the direct 
and inverse transforms of many functions, but also in obtaining several valuable 
results in signal processing. The reader should not fail to observe the ever-present 
duality in this discussion. We begin with the symmetry property, which is one of 
the consequences of the duality principle discussed. 


4.3-2 Symmetry Property 
This property states that if 


f(t) = F(u) 
then 


F(t) <=> 2nf(—w) (4.31) 
Proof: According to Eq. (4.8b) 
f(t) = = Ja 7 F(2)e* de 
Hence 
anf(—t) = / c F(a)e~#** de 


Changing t to w yields Eq. (4.31). 


a Example 4.8 
In this example we apply the symmetry property [Eq. (4.31)] to the pair in Fig. 4.17a. 
From Eq. (4.23) we have 


rect (=) <=> T sinc (=) (4.32) 
a ——< a 
F(t) F(w) 


Also, F(t) is the same as F(w) with w replaced by t, and f(—w) is the same as f(t) with 
t replaced by —w. Therefore, the symmetry property (4.31) yields 


T sinc (=) <=> 2nrect (=) = 2rrect (2) (4.33) 
2 T T 
Nera a 
F(t) an f(—w) 


In Eq. (4.33) we used the fact that rect (—x) = rect (x) because rect is an even function. 
Figure 4.17b shows this pair graphically. Observe the interchange of the roles of t and w 
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Fig. 4.17 Symmetry property of the Fourier transform. 


(with the minor adjustment of the factor 27). This result appears as pair 18 in Table 4.1 
(with 7/2 = W). 


As an interesting exercise, the reader should generate the dual of every pair in Table 
4.1 by applying the symmetry property. Ml 


A Exercise E4.5 
Apply symmetry property to pairs 1, 3, and 9 (Table 4.1) to show that 


(a) jira <=> Ire u(—w) (b) mir <=> Ire— ale! 
(c) 6(t + to) + 6(t — to) <= 2cos tow Vv 
4.3-3 The Scaling Property 
If 
f(t) = Fl) 


then, for any real constant a, 


flat) => a (2) (4.34) 


Proof: For a positive real constant a, 


F[f(at)] = J” tones dt = i f(2)e IDE dy = “F (2) 


a 


Similarly, we can demonstrate that if a < 0, 


flat) <= Ip (2) 


a a 


Hence follows Eq. (4.34). 
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F(@) 


| 
ala 

e 

t 


Fig. 4.18 Scaling property of the Fourier transform. 


Significance of the Scaling Property 


The function f (at) represents the function f(t) compressed in time by a factor 
a (see Sec. 1.3-2). Similarly, a function F(#) represents the function F (w) expanded 
in frequency by the same factor a. The scaling property states that time compression 
of a signal results in its spectral expansion, and time expansion of the signal results 
in its spectral compression. Intuitively, compression in time by a factor a means 
that the signal is varying rapidly by the same factor. To synthesize such a signal, 
the frequencies of its sinusoidal components must be increased by the factor a, 
implying that its frequency spectrum is expanded by the factor a. Similarly, a 
signal expanded in time varies more slowly; hence the frequencies of its components 
are lowered, implying that its frequency spectrum is compressed. For instance, the 
signal cos 2wot is the same as the signal cos wot time-compressed by a factor of 2. 
Clearly, the spectrum of the former (impulse at +2w9) is an expanded version of the 
spectrum of the latter (impulse at two). The effect of this scaling is demonstrated 
in Fig. 4.18. 


Reciprocity of Signal Duration and Its Bandwidth 

The scaling property implies that if f(t) is wider, its spectrum is narrower, 
and vice versa. Doubling the signal duration halves its bandwidth and vice versa. 
This suggests that the bandwidth of a signal is inversely proportional to the signal 
duration or width (in seconds). We have already verified this fact for the gate pulse, 
where we found that the bandwidth of a gate pulse of width 7 seconds is 4 Hz. More 
discussion of this interesting topic appears in the literature.” 

By letting a = —1 in Eq. (4.34), we obtain the time and frequency inversion 
property 


f(-t) = F(-w) (4.35) 
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E Example 4.9 


Find the Fourier transforms of e**u(—t) and e~?!"!, 
Application of Eq. (4.35) to pair 1 (Table 4.1) yields 


e“u(—t) > 


a- jw 
Also 
elt e u(t) + e**u(—t) 


Therefore 
1 1 2a 


-+ — = 
a+jw a-jw @+w? 


(4.36) 


The signal e~°!*! and its spectrum are illustrated in Fig. 4.19. E 


fayz! ——> 


t— 


Fig. 4.19 e~¢l4l and its Fourier spectrum. 


4.3-4 The Time-Shifting Property 
If 


f(t) = F(w) 
then 


f(t- to) => F(w)e ito (4.37a) 
Proof: By definition, 
F [f(t — to)| = Í f(t — toe 7" dt 


Letting t — to = z, we have 
oo . 
Fire tol] = f sleet) de 
—0o 


[e o] 
= e~iuto f f(2)e Ti? dz = F(w)e~Suto (4.37b) 
-00 


This result shows that delaying a signal by to seconds does not change its amplitude 
spectrum. The phase spectrum, however, is changed by —wtg. 


Physical Explanation of the Linear Phase 

Time delay in a signal causes a linear phase shift in its spectrum. This result 
can also be derived by heuristic reasoning. Imagine f(t) being synthesized by its 
Fourier components, which are sinusoids of certain amplitudes and phases. The 
delayed signal f(t — to) can be synthesized by the same sinusoidal components, 
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Fig. 4.20 Physical explanation of the time-shifting property. 


each delayed by to seconds. The amplitudes of the components remain unchanged. 
Therefore, the amplitude spectrum of f (t — to) is identical to that of f(t). The time 
delay of to in each sinusoid, however, does change the phase of each component. 
Now, a sinusoid cos wt delayed by to is given by 


cos w(t — to) = cos (wt — wto) 


Therefore a time delay to in a sinusoid of frequency w manifests as a phase delay 
of wto. This is a linear function of w, meaning that higher-frequency components 
must undergo proportionately higher phase shifts to achieve the same time delay. 
This effect is depicted in Fig. 4.20 with two sinusoids, the frequency of the lower 
sinusoid being twice that of the upper. The same time delay to amounts to a phase 
shift of +/2 in the upper sinusoid and a phase shift of m in the lower sinusoid. This 
verifies the fact that to achieve the same time delay, higher-frequency sinusoids must 
undergo proportionately higher phase shifts. The principle of linear phase shift is 
very important and we shall encounter it again in distortionless signal transmission 
and filtering applications. 


E Example 4.10 
Find the Fourier transform of e 
This function, shown in Fig. 4.21a, is a time-shifted version of e~*l"l (depicted in Fig. 
4.19a). From Eqs. (4.36) and (4.37) we have 


—alé—to| 


—alt— 2a -jw 
ew alttol e= yur Jeg (4.38) 


The spectrum of e~?!*-*ol (Fig. 4.21b) is the same as that of ell (Fig. 4.19b), except 
for an added phase shift of —wto . 

Observe that the time delay to causes a linear phase spectrum —wto. This example 
clearly demonstrates the effect of time shift. a 


4.3 Some Properties of the Fourier Transform 259 


IF(@) |= 2 


2 


feye 
a*+0 


(b) 


o> 


Z£F@)=-0f 
Fig. 4.21 Effect of time-shifting on the Fourier spectrum of a signal. 


a Example 4.11 
Find the Fourier transform of the gate pulse f(t) illustrated in Fig. 4.22a. 
The pulse f(t) is the gate pulse rect (2) in Fig. 4.10a delayed by 7/2 seconds. Hence, 


according to Eq. (4.37a), its Fourier transform is the Fourier transform of rect (2) multi- 
> -ji 4 
plied by e~2”4. Therefore 


F(w) = rsinc (+) ea 


The amplitude spectrum |F(w)| (depicted in Fig. 4.22b) of this pulse is the same as that 
indicated in Fig. 4.10c. But the phase spectrum has an added linear term —wr/2. Hence, 
the phase spectrum of f(t) is identical to that in Fig. 4.10b plus a linear term —w7 /2, as 
indicated in Fig. 4.22c. 

A Exercise E4.6 


Using pair 18 and the time-shifting property, show that the Fourier transform of 


sinc [wo(t ~ T)} is on rect (ge )e"Ie?. Sketch the amplitude and phase spectra of the Fourier 
transform. VY 


fay É (a) 


m 4.22 Another example of time-shifting and its effect on the Fourier spectrum of a 
signal. 


4.3-5 The Frequency-Shifting Property 
If 


ai f(t) = Fw) 


f(t) > F(w ~ wo) (4.39) 
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F(t) cos wt 


Fig. 4.23 Amplitude modulation of a signal causes spectral shifting. 


Proof: By definition, 


FIF (te!) = if i ftjetote tdt = i t f(teni-Mo)tae = F(w — wo) 


According to this property, the multiplication of a signal by a factor ejvot shifts 
the spectrum of that signal by w = wo. Note the duality between the time-shifting 
and the frequency-shifting properties. 

Changing wo to —wo in Eq. (4.39) yields 


f(t)e 99" <=> F(w + wo) (4.40) 
Because et is not a real function that can be generated, frequency shifting in 
practice is achieved by multiplying f(t) by a sinusoid. This assertion follows from 
the fact that l l 
F(t) cos wot = 5[f(the™? + f(the™""] 
From Eqs. (4.39) and (4.40), it follows that 


f(t) cos wot ==> $[F(w — wo) + F (w + wo)] (4.41) 


This result shows that the multiplication of a signal f(t) by a sinusoid of frequency 
wo shifts the spectrum F(w) by two, as depicted in Fig. 4.23. 
Multiplication of a sinusoid cos wot by f (t) amounts to modulating the sinusoid 
amplitude. This type of modulation is known as amplitude modulation. The si- 
nusoid cos wot is called the carrier, the signal f(t) is the modulating signal, and 
the signal f(t) cos wot is the modulated signal. Further discussion of modulation 
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f(r) 


Fig. 4.24 An example of spectral shifting by amplitude modulation. 


and demodulation appears in Secs. 4.7 and 4.8. 
To sketch a signal f(t) cos wot, we observe that 


f(t) when cos wot = 1 
f(t) cos wot = 

—f(t) when cos wot = —1 
Therefore, f(t) cos wot touches f(t) when the sinusoid cos wot is at its positive peaks 
and touches — f(t) when cos wot is at its negative peaks. This means that f (t) and 
-f (t) act as envelopes for the signal f(t) cos wot (see Fig. 4.23). The signal — f(t) 
is a mirror image of f(t) about the horizontal axis. Figure 4.23 shows the signal 
f(t), f(t) cos wot and their spectra. 


E Example 4.12 
Find and sketch the Fourier transform of the modulated signal f(t) cos 10t in which 
f(t) is a gate pulse rect ($) as illustrated in Figure 4.24a. 


From pair 17 (Table 4.1) we find rect ($) <= 4 sinc(2w), which is depicted in Fig. 
4.24b. From Eq. (4.41) it follows that 


F(t) cos 10t => $[F(w + 10) + F(w — 10)} 


In this case, F(w) = 4 sinc (2w). Therefore 


F(t) cos 10t <=> 2 sinc [2(w + 10)] + 2 sinc [2(w — 10)] 


The spectrum of f(t) cos 10t is obtained by shifting F(w) in Fig. 4.24b to the left by 
10 and also to the right by 10, and then multiplying it by one-half, as depicted in Fig. 
4.244. W 


A Exercise E4.7 
Sketch signal e~!*! cos 10t. Find the Fourier transform of this signal and sketch its spectrum. 


Answer: F(w) = Gantt + COS The spectrum is that in Fig. 4.19b (with a = 1), shifted 
to +10 and multiplied by one-half. y 


Application to Modulation 


Modulation is used to shift signal spectra. Some of the situations where spec- 
trum shifting is necessary are presented next. 


262 4 Continuous-Time Signal Analysis: The Fourier Transform 


He calls it 


He claims this method SMODULATION. z 


incorporates the best 
of two older methods, 


Eastern Telecom. Co. «rte Latest in Technology 


« 
O 


1. If several signals, each occupying the same frequency band, are transmitted 
simultaneously over the same transmission medium, they will all interfere; it 
will be impossible to separate or retrieve them at a receiver. For example, if 
all radio stations decide to broadcast audio signals simultaneously, the receiver 
will not be able to separate them. This problem is solved by using modulation, 
whereby each radio station is assigned a distinct carrier frequency. Each sta- 
tion transmits a modulated signal. This procedure shifts the signal spectrum 
to its allocated band, which is not occupied by any other station. A radio 
receiver can pick up any station by tuning to the band of the desired station. 
The receiver must now demodulate the received signal (undo the effect of mod- 
ulation). Demodulation therefore consists of another spectral shift required to 
restore the signal to its original band. Note that both modulation and demod- 
ulation implement spectral shifting; consequently, demodulation operation is 
similar to modulation (see Sec. 4.7). 

This method of transmitting several signals simultaneously over a channel by 
sharing its frequency band is known as frequency-division multiplexing 
(FDM). 

2. For effective radiation of power over a radio link, the antenna size must be of the 
order of the wavelength of the signal to be radiated. Audio signal frequencies 
are so low (wavelengths are so large) that impracticably large antennas will be 
required for radiation. Here, shifting the spectrum to a higher frequency (a 
smaller wavelength) by modulation solves the problem. 


4.3-6 Convolution 


The time convolution property and its dual, the frequency convolution property, 
state that if 


filt) => Filw) and falt) = Fz(w) 
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then (time convolution) 


filt) * falt) > Fy(w)Fo(w) (4.42) 
and (frequency convolution) 
Alt)falt) = Flv) * Falo) (4.43) 


Proof: By definition 


FIRE) * falt)| = T ae | a p AMhlt - ra] dt 


= in filr) [etal - na| dr 


The inner integral is the Fourier transform of f2(¢ — r), given by [time-shifting 
property in Eq. (4.37)] Fo(w)e2“". Hence 


Fina = f Snan = Fa(w) [ ” pale dr = Fy(w)Fo(w) 


We have demonstrated in Eq. (2.48) that the transfer function H(w) is the 
Fourier transform of the unit impulse response h(t). Thus 
h(t) = > H(w) (4.44a) 
Application of the time convolution property to y(t) = f(t) * h(t) yields (assuming 
both f(t) and A(t) are Fourier transformable) 
Y (w) = F(w)H (w) (4.44b) 


This is precisely the result proved earlier in Eq. (4.19).+ 
The frequency convolution property (4.43) can be proved in exactly the same 
way by reversing the roles of f(t) and F(w). 


a Example 4.13 
Using the time convolution property, show that if 


f(t) = Fw) 
then : 
/ f(r)dt = oe! + 7F(0)5(w) (4.45) 
Because 
wef TE 


it follows that 


f(t) *u(t) = / f(r)u(t — r)dr = i. f(r) dr 


fin Eq. (4.44b), h(t) <=> H(w). To understand finer points of Eq. (4.44b), see footnote on p. 243. 
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Now, from the time convolution property [Eq. 4.42], it follows that 


t 
f(t) *u(t) = | flr)dr F(u) È sto) 


=F) 5 eFPO)5(w) 
jw 


In deriving the last result, we used Eq. (1.23a) u 


A Exercise E4.8 
Using the time convolution property, show that f(t) * 6(t) = f(t) V 


A Exercise E4.9 
Using the time convolution property, show that 


e u(t) xe7 u(t) = z 1 x Ca - ew] u(t) 


Hint: Use property (4.42) to find the Fourier transform of e~%u(t) x e—*tu(t). Then use partial 
fraction expansion to find its inverse Fourier transform. Y 


4.3-7 Time Differentiation and Time Integration 


If 
f(t) = Flv) 
then (time differentiation) { 
a = juP (w) (4.46) 
and (time integration) 
f 7 f(r)dr == a + 1 F(0)5(w) (4.47) 


Proof: Differentiation of both sides of Eq. (4.8b) yields 


This result shows that 


{Valid only if the transform of df /dt exists. 
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Table 4.2 


Fourier Transform Operations 
a U a U M U U U a 


Operation f(t) F(w) 
Addition filt) + falt) Fi(w) + Faw) 
Scalar multiplication kf (t) kF(w) 
Symmetry F(t) Qn f(—w) 
; 1 w 
Scaling (a real) flat) ae (=) 
Time shift f(t — to) F(w)e~Jvto 
Frequency shift (wọ real) f (t)erwot F(w — wo) 
Time convolution filt) * fo(t) Fy (w) Fo(w) 
Frequency convolution Falt) falt) =f (w) * Fo(w) 
3 ; a d"f : 
Time differentiation ETT (jw) F (w) 
hea , i F(w) 
Time integration f(z)dz — + mF (0)5(w) 
—o0o jw 


bn —————— 


Repeated application of this property yields 


TI = (jw) Fw) (4.48) 
a” jw w £ 
The time-integration property [Eq. (4.47)] has already been proved in Example 
4.13. 


E Example 4.14 

Using the time-differentiation property, find the Fourier transform of the triangle 
pulse A(Ż) illustrated in Fig. 4.25a. 

To find the Fourier transform of this pulse we differentiate the pulse successively, 
as illustrated in Fig. 4.25b and c. Because df/dt is constant everywhere, its derivative, 
d? f /dt?, is zero everywhere. But df /dt has jump discontinuities with a positive jump of 
2/7 at t = +3, and a negative jump of 4/7 at t = 0. Recall that the derivative of a 
signal at a jump discontinuity is an impulse at that point of strength equal to the amount 
of jump. Hence, d?f/dt?, the derivative of df /dt, consists of a sequence of impulses, as 
depicted in Fig. 4.25c; that is, 

2 
TE = Blet + g) 28l) + ele- p) (4.49) 
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Fig. 4.25 Finding the Fourier transform of a piecewise-linear signal using the time- 
differentiation property. 


From the time-differentiation property (4.48) 


a <=> (jw)? Fw) = -w F(u) (4-50a) 


Also, from the time-shifting property (4.37) 


Elt — to) s= e 2? (4.50b) 
Taking the Fourier transform of Eq. (4.49) and using the results in Eqs. (4.50), we obtain 


-WF (w) = 2f F — 2+ TF] = 4 (cos 4 ~ 1) = -È sin? (17) 


and 


pwr 2 
8 ao fwr\) _T sin (“7) this e (5) (4.51) 
F(w)= oi, on (=) =z | wz 3 sin 7 
The spectrum F (w) is depicted in Fig. 4.25d. This procedure of finding the Fourier trans- 
form can be applied to any function f(t) made up of straight-line segments with f(t)—> 0 
as |t| — oo. The second derivative of such a signal yields a sequence of impulses whose 
Fourier transform can be found by inspection. This example suggests a numerical method 
of finding the Fourier transform of an arbitrary signal f(t) by approximating the signal by 
straight-line segments. a 


A Exercise E4.10 
Find the Fourier transform of rect (4), using the time-differentiation property. Y 
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4.4 Signal Transmission through LTIC Systems 


If f(t) and y(t) are the input and output of an LTIC system with transfer 
function H(w), then, as demonstrated in Eq. (4.44b) 


Y(w) = H(w)F (w) (4.52) 


This result applies only to asymptotically (and marginally) stable systems because 
of the reasons discussed in the footnote of p. 243. Moreover, f(t) has to be Fourier 


transformable. Consequently, exponentially growing inputs cannot be handled by 
this method. 


In Chapter 6, we shall see that the Laplace transform, which is a generalized 
Fourier transform, is more versatile and capable of analyzing all kinds of LTIC 
systems whether stable, unstable, or marginally stable. Laplace transform can also 
handle exponentially growing inputs. Compared to the Laplace transform, the 
Fourier transform in system analysis is clumsier. Hence, the Laplace transform 
is preferable to the Fourier transform in LTIC system analysis, and we shall not 
belabor the application of the Fourier transform to LTIC system analysis. We 
consider just one example here. 


E Example 4.15 
Find the zero-state response of a stable LTIC system with transfer functiont 


1 
and the input f(t) = e~*u(t). In this case, 

eee. 

jw+2 


F(w) = and H(w) = H(s)|e=jv = 


jw+ 1 
Therefore 


Y(w) = H(w)F(w) 
= 1 
~ Gw + 2)(jw + 1) 
Expanding the right-hand side in partial fractions (Sec. B.5) 


1 1 


YW)" joe] jora 


(4.54) 


and 


y(t) = (e -eut E 


A Exercise E4.11 


For the system in Example 4.15, show that the zero-input response to the input e*u(—t) is 
y(t) = 4fetu(—t) + e-**u(t)}. 
Hint: Use pair 2 (Table 4.1) to find the Fourier transform of etu(—t). y 


{Stability implies that the region of convergence of H(s) includes the jw axis. 
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4.4-1 Signal Distortion during Transmission 


For a system with transfer function H (w), if F(w) and Y (w) are the spectra of 
the input and the output signals, respectively, then 


Y (w) = F(w)H (w) (4.55) 


The transmission of the input signal f(t) through the system changes it into the 
output signal y(t). Equation (4.55) shows the nature of this change or modification. 
Here F(w) and Y (w) are the spectra of the input and the output, respectively. 
Therefore, H(w) is the spectral response of the system. The output spectrum is 
obtained by the input spectrum multiplied by the spectral response of the system. 
Equation (4.55), which clearly brings out the spectral shaping (or modification) of 
the signal by the system, can be expressed in polar form as 


IY (o) = P (WJH (v) tR 


Therefore 
IY (w)| = |F (w) H (w)| (4.56a) 


LY (w) = LF (w) + ¿H (w) (4.56b) 


During transmission, the input signal amplitude spectrum |F(w)| is changed to 
|F(w)||H(w)|. Similarly, the input signal phase spectrum LF(w) is changed to 
LF(w) + 2H(w). An input signal spectral component of frequency w is modified in 
amplitude by a factor |H(w)| and is shifted in phase by an angle ZH (w). Clearly, 
|H(w)| is the amplitude response, and 4H (w) is the phase response of the sys- 
tem. The plots of |H(w)| and ZH (w) as functions of w show at a glance how the 
system modifies the amplitudes and phases of various sinusoidal inputs. For this 
reason, H (w) is called the frequency response of the system. During transmis- 
sion through the system, some frequency components may be boosted in amplitude, 
while others may be attenuated. The relative phases of the various components also 
change. In general, the output waveform will be different from the input waveform. 


Distortionless Transmission 


In several applications, such as signal amplification or message signal trans- 
mission over a communication channel, we require that the output waveform be a 
replica of the input waveform. In such cases we need to minimize the distortion 
caused by the amplifier or the communication channel. It is, therefore, of practical 
interest to determine the characteristics of a system that allows a signal to pass 
without distortion (distortionless transmission). 

Transmission is said to be distortionless if the input and the output have iden- 
tical waveshapes within a multiplicative constant. A delayed output that retains 
the input waveform is also considered distortionless. Thus, in distortionless trans- 
mission, the input f(t) and the output y(t) satisfy the condition 


y(t) = kf (t — ta) (4.57) 
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Fig. 4.26 LTIC system Frequency response for distortionless transmission. 


The Fourier transform of this equation yields 


Y (w) = kF(w)e 34% 
But 


Therefore eee) 


H(w) = ke ita 


This is the transfer function required for distortionless transmission. From this 
equation it follows that 


|H (w)| =k (4.58a) 
LH (w) = —wta (4.58b) 


This result shows that for distortionless transmission, the amplitude response |H (w)| 
must be a constant, and the phase response ZH (w) must be a linear function of w 
with slope —ta, where tg is the delay of the output with respect to input (Fig. 4.26). 


Intuitive Explanation of the Distortionless Transmission Conditions 

It is instructive to derive the conditions for distortionless transmission heuris- 
tically. Once again, imagine f(t) to be composed of various sinusoids (its spectral 
components), which are being passed through a distortionless system. For the dis- 
tortionless case, the output signal is the input signal multiplied by k and delayed 
by tg. To synthesize such a signal, we need exactly the same components as those 
of f(t), with each component multiplied by k and delayed by tag. Thus, the sys- 
tem transfer function H (w) should be such that each sinusoidal component suffers 
the same attenuation k and each component undergoes the same time delay of ta 
seconds. The first condition requires that 


|H(w)| =k 


We have seen in our discussion on p. 258 that to achieve the same time delay ta for 
every frequency component requires a linear phase delay wta (Fig. 4.20). Therefore 


LH (w) = —wta 
This equation shows that the time delay resulting from signal transmission through 


a system is the negative of the slope of the system phase response ZH (w); that is, 


ee -Z LHe) (4.59) 
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If the slope of ZH (w) is constant (that is, if ZH (w) is linear with w), all the compo- 
nents are delayed by the same time interval ta. But if the slope is not constant, the 
time delay tg varies with frequency. This variation means that different frequency 
components undergo different amounts of time delay, and consequently the output 
waveform will not be a replica of the input waveform. A good way to judge phase 
linearity is to plot tg as a function of frequency. For a distortionless system, ta 
should be constant over the band of interest. 

It is often thought (erroneously) that flatness of amplitude response |H (w)| 
alone can guarantee signal quality. However, a system may have a flat amplitude 
response and yet distort a signal beyond recognition if the phase response is not 
linear (tą not constant). 


The Nature of Distortion in Audio and Video Signals 

Generally speaking, a human ear can readily perceive amplitude distortion, 
although it is relatively insensitive to phase distortion. For the phase distortion to 
become noticeable, the variation in delay [variation in the slope of ZH (w)]} should 
be comparable to the signal duration (or the physically perceptible duration, in 
case the signal itself is long). In the case of audio signals, each spoken syllable can 
be considered as an individual signal. The average duration of a spoken syllable is 
of a magnitude of the order of 0.01 to 0.1.seconds. The audio systems may have 
nonlinear phases, yet no noticeable signal distortion results because in practical 
audio systems, maximum variation in the slope of ZH (w) is only a small fraction 
of a millisecond. This is the real truth underlying the statement that “the human 
ear is relatively insensitive to phase distortion.”* As a result, the manufacturers of 
audio equipment make available only |H (w)|, the amplitude response characteristic 
of their systems. 

For video signals, in contrast, the situation is exactly the opposite. The human 
eye is sensitive to phase distortion but is relatively insensitive to amplitude dis- 
tortion. The amplitude distortion in television signals manifests itself as a partial 
destruction of the relative half-tone values of the resulting picture, which is not 
readily apparent to the human eye. The phase distortion (nonlinear phase), on the 
other hand, causes different time delays in different picture elements. The result is 
a smeared picture, which is readily perceived by the human eye. Phase distortion is 
also very important in digital communication systems because the nonlinear phase 
characteristic of a channel causes pulse dispersion (spreading out), which in turn 
causes pulses to interfere with neighboring pulses. This interference can cause an 
error in the pulse amplitude at the receiver: a binary 1 may read as Q, and vice 
versa. 


4.5 Ideal and practical filters 


Ideal filters allow distortionless transmission of a certain band of frequencies 
and suppress all the remaining frequencies. The ideal lowpass filter (Fig. 4.27), for 
example, allows all components below w = W rad/s to pass without distortion and 
suppresses all components above w = W. Figure 4.28 illustrates ideal highpass and 
bandpass filter characteristics. 

The ideal lowpass filter in Fig. 4.27a has a linear phase of slope —tg, which 
results in a time delay of tg seconds for all its input components of frequencies 
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Fig. 4.27 Ideal lowpass filter: its frequency response and impulse response. 


below W rad/s. Therefore, if the input is a signal f(t) bandlimited to W rad/s, the 
output y(t) is f(t) delayed by tg; that is, 


y(t) = f(t - ta) 


The signal f(t) is transmitted by this system without distortion, but with time 
delay ta. For this filter |H (w)| = rect (47) and ZH (w) = eJ#*¢, so that 


H (w) = rect (=) e Juta (4.60a) 


The unit impulse response h(t) of this filter is obtained from pair 18 (Table 4.1) 
and the time-shifting property 


h(t) = F7! [rect (=) gt 
= z sinc [W (t — ta)] (4.60b) 


Recall that h(t) is the system response to impulse input 6(t), which is applied at 
t = 0. Figure 4.27b shows a curious fact: the response h(t) begins even before the 
input is applied (at t = 0). Clearly, the filter is noncausal and therefore physically 
unrealizable. Similarly, one can show that other ideal filters (such as the ideal 
highpass or the ideal bandpass filters depicted in Fig. 4.28) are also physically 
unrealizable. 

For a physically realizable system, h(t) must be causal; that is, 


h(t) =0 fort < 0 


In the frequency domain, this condition is equivalent to the well-known Paley- 
Wiener criterion, which states that the necessary and sufficient condition for the 
amplitude response |H (w)| to be realizable is 


co 
| In} A (w)I | 
J: go Y < œœ (4.61) 
If H (w) does not satisfy this condition, it is unrealizable. Note that if |H(w)| = 0 
over any finite band, | In| H (w)|| = œœ over that band, and the condition (4.61) is vi- 
olated. If, however, H (w) = 0 at a single frequency (or a set of discrete frequencies), 
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Fig. 4.28 Ideal highpass and bandpass filter frequency response. 
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Fig. 4.29 Approximate realization of an ideal lowpass filter by truncation of its impulse 
response. 


the integral in Eq. (4.61) may still be finite even though the integrand is infinite. 
Therefore, for a physically realizable system, H (w) may be zero at some discrete 
frequencies, but it cannot be zero over any finite band. According to this criterion, 
ideal filter characteristics (Figs. 4.27 and 4.28) are clearly unrealizable.t 

The impulse response h(t) in Fig. 4.27 is not realizable. One practical approach 
to filter design is to cut off the tail of h(t) for t < 0. The resulting causal impulse 


response R(t), where 


h(t) = A(t)u(t) 


is physically realizable because it is causal (Fig. 4.29). If ta is sufficiently large, h(t) 
will be a close approximation of h(t), and the resulting filter H (w) will be a good 
approximation of an ideal filter. This close realization of the ideal filter is achieved 
because of the increased value of time-delay tg. This observation means that the 
price of close realization is higher delay in the output; this situation is common in 
noncausal systems. Of course, theoretically, a delay tg = 00 is needed to realize the 
ideal characteristics. But a glance at Fig. 4.27b shows that a delay ta of three or four 
times 7 will make h(t) a reasonably close version of h(t—tg). For instance, an audio 


+|H(w)| is assumed to be square-integrable, that is, 
co 
J |H(w)|? dw 
-00 


is finite. Note that the Paley-Wiener criterion is a criterion for the realizability of the amplitude 
response |H(w)|- 
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filter is required to handle frequencies of up to 20 kHz (W = 40, 0007). In this case, 
a ta of about 1074 (0.1 ms) would be a reasonable choice. The truncation operation 
(cutting the tail of A(t) to make it causal), however, creates some unsuspected 
problems. We discuss these problems and their cure in Sec. 4.9. 

In practice, we can realize a variety of filter characteristics to approach ideal 
characteristics. Practical (realizable) filter characteristics are gradual, without jump 
discontinuities in amplitude response. We shall study such filter families (Butter- 
worth and Chebyshev) in Secs. 7.4 and 7.5. Figure 7.17 illustrates the amplitude 
response of lowpass Butterworth filters. 


ô Exercise E4.12 


Show that a filter with Gaussian transfer function H(w) = e~?” is unrealizable. Demon- 
strate this fact in two ways: first by showing that its impulse response is noncausal, and then by 
showing that |H(w)| violates the Paley-Wiener criterion. 


Hint: Use pair 22 in Table 4.1 7 


Thinking in Time- and Frequency-Domains: A Two Dimensional View of 
Signals and Systems 


Both signals and systems have dual personalities; the time domain and the fre- 
quency domain. For a deeper perspective, we should examine and understand both 
these identities because they offer complementary insights. An exponential signal, 
for instance, can be specified by its time domain description such as e~?*u(t) or by 
its Fourier transform (its frequency domain description) art The time-domain 
description depicts the waveform of a signal. The frequency-domain description por- 
trays its spectral composition (relative amplitudes of its sinusoidal (or exponential) 
components and their phases). For the signal e~**, for instance, the time-domain 
description portrays the exponentially decaying signal with a time constant 0.5. 
The frequency-domain description characterizes it as a lowpass signal, which can 
be synthesized by sinusoids with amplitudes decaying with frequency roughly as 
L/w. 

An LTIC system can also be described or specified in the time domain by its 
impulse response h(t) or in the frequency domain by its transfer function H(w). In 
Sec. 2.7, we studied intuitive insights in the system behavior offered by the impulse 
response, which consists of characteristic modes of the system. By purely qualitative 
reasoning, we saw that the system responds well to signals that are similar to the 
characteristic modes and responds poorly to signals which are very different from 
those modes. We also saw that the shape of the impulse response h(t) determines 
the system time constant (speed of response), and pulse dispersion (spreading), 
which, in turn, determines the rate of pulse transmission. 

The transfer function H (w) specifies the frequency response; that is, the system 
response to exponential or sinusoidal input of various frequencies. This is precisely 
the filtering characteristic of the system. ` 

Experienced electrical engineers instinctively think in both domains (the time 
and frequency) whenever possible. When they look at a signal, they consider, its 
waveform, the signal width (duration), and the rate at which the waveform de- 
cays. This is basically a time-domain perspective. They also think of the signal 
in terms of its frequency spectrum-that is, in terms of its sinusoidal components 
and their relative amplitudes and phases. This is the frequency-domain perspective. 
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When they think of a system, they think of its impulse response A(t). The width 
of A(t) indicates the time constant (response time); that is, how fast the system 
is capable of responding to an input, and how much dispersion (spreading) it will 
cause. This is the time-domain perspective. From the frequency-domain perspec- 
tive, these engineers view a system as a filter, which selectively transmits certain 
frequency components and suppresses the others [frequency response H(w)]. Know- 
ing the input signal spectrum and the frequency response of the system, they create 
a mental image of the output signal spectrum. This concept is precisely expressed 
by Y(w) = F(w)H (w). 

We can analyze LTI systems by time-domain techniques or by frequency- 
domain techniques. Then why learn both? The reason is that the two domains 
offer complementary insights into system behavior. Some aspects are easily grasped 
in one domain; other aspects may be easier to see in the other domain. Both the 
time-domain and the frequency-domain methods are as essential for the study of 
signals and systems as two eyes are essential to a human being for correct visual 
perception of reality. A person can see with either eye, but for proper perception 
of three dimensional-reality, both eyes are essential. 

It is important to keep the two domains separate, and not to mix the entities 
in the two domains. If we are using the frequency domain to determine the system 
response, we must deal with all signals in terms of their spectra (Fourier transforms) 
and all systems in terms of their transfer functions. For example, to determine the 
system response y(t) to an input f(t), we must first convert the input signal into 
its frequency domain description F(w). The system description also must be in the 
frequency-domain; that is, the transfer function H(w). The output signal spectrum 
Y(w) = F(w)H(w). Thus, the result (output) is also in the frequency domain. To 
determine the final answer y(t), we must take the inverse transform of Y (w). 


4.6 Signal Energy 
The signal energy Eş of a signal f(t) was defined in Chapter 1 as 


E= f OPa (4.62) 


7 —co 
Signal energy can be related to the signal spectrum F(w) by substituting Eq. (4.8b) 
in the above equation: 


Ey = f i. f(t)f*(t) dt = a i f(t) E Í = F(u a] di 


Here we used the fact that f*(t), being the conjugate of f(t), can be expressed as 
the conjugate of the right-hand side of Eq. (4.8b). Now, interchanging the order of 
integration yields 


Ep = f z F*(w) | f K ftetit a| dv 
= = [Perea 


3 = J F) dw (4.63) 
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Fig. 4.30 Interpretation of Energy spectral density of a signal. 


Consequently, 


CO 1 co 
Er= | OPa E f7 PoPa (4.64) 
—oo T J- 

This is the statement of the well-known Parseval’s theorem (for Fourier trans- 
form). A similar result was obtained in Eqs. (3.42)and (3.82) for a periodic signal 
and its Fourier series. This result allows us to determine the signal energy from ei- 
ther the time-domain specification f(t) or the frequency-domain specification F(w) 
of the same signal. 

Equation (4.63) can be interpreted to mean that the energy of a signal f(t) 
results from energies contributed by all the spectral components of the signal f (t). 
The total signal energy is the area under |F(w)?| (divided by 27). If we consider a 
small band Aw (Aw — 0), as illustrated in Fig. 4.30, the energy AE y of the spectral 
components in this band is the area of |F (w)|? under this band (divided by 27): 

AE; = ZIFU)? Aw =|Fw)Par Ê = AFH (4.65) 
Qn 
Therefore, the energy contributed by the components in this band of AF (in hertz) 
is |F(w)|?AF. The total signal energy is the sum of energies of all such bands and 
is indicated by the area under |F(w)|* as in Eq. (4.63). Therefore, |F(w)|? is the 
energy spectral density (per unit bandwidth in hertz). 

For real signals, F(w) and F(—w) are conjugates, and |F(w)|? is an even func- 

tion of w because 
|F(w)? = F(w)F*(w) = Fw) F(-w) 


Therefore, Eq. (4.63) can be expressed ast 


z= [F(w)|? dw (4.66) 


The signal energy Ep, which results from contributions from all the frequency com- 
ponents from w = 0 to oo, is given by (1/7 times) the area under |F(w)|? from w = 0 


to oo. It follows that the energy contributed by spectral components of frequencies 
between w; and wa is 


1s” 
AEs = if |F (w)|? dw (4.67) 


wy 


tin Eq. (4.66) it is assumed that F(w) does not contain an impulse at w = 0. If such an impulse 
exists, it should be integrated separately with a multiplying factor of 1 /2m rather than 1/7. 
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E Example 4.16 

Find the energy of signal f(t) = e~**u(t). Determine the frequency W (rad/s) so 
that the energy contributed by the spectral components of all the frequencies below W is 
95% of the signal energy Ep. 


We have PA S5 1 
= 2 = —at yy dn 
Ey = ye f (t)dt = l e dt 2a 


We can verify this result by Parseval’s theorem. For this signal 


PW) oa 
and 
1 ba 2 1 i 1 1 -1 Ww}? 1 
je a =- — = — ft. — = — 
Erz a [F(w) [dw F gya ma eeg o 2a 


The band w = 0 to w = W contains 95% of the signal energy, that is, 0.95/2a. 
Therefore, from Eq. (4.67) with wı = 0 and wz = W, we obtain 


w w 
0.96 af” i odt oLan E 
2a T Jo w? +a? Ta alo na 
or 
236m = tan`! z = W = 12.706a rad/s 


This result indicates that the spectral components of f(t) in the band from 0 (dc) to 
12.706a rad/s (2.02a Hz) contribute 95% of the total signal energy; all the remaining 
spectral components (in the band from 12.706a rad/s to oc) contribute only 5% of the 
signal energy. | 


A Exercise £4.13 , 
Use Parseval’s theorem to show that the energy of the signal 


f) = 


2a 
t2 + a? 


is an. Hint: Find F(w) using pair 3 and the symmetry property. V 


The Essential Bandwidth of a Signal 

Spectra of most of the signals extend to infinity. However, because the energy 
of any practical signal is finite, the signal spectrum must approach 0 as w => ov. 
Most of the signal energy is contained within a certain band of B Hz, and the 
energy contributed by the components beyond B Hz is negligible. We can therefore 
suppress the signal spectrum beyond B Hz with little effect on the signal shape and 
energy. The bandwidth B is called the essential bandwidth of the signal. The 
criterion for selecting B depends on the error tolerance in a particular application. 
We may, for example, select B to be that band which contains 95% of the signal 
energy.t This figure may be higher or lower than 95%, depending on the precision 
needed. Using such a criterion, we can determine the essential bandwidth of a signal. 
The essential bandwidth B for the signal e~**u(¢), using 95% energy criterion, was 
determined in Example 4.16 to be 2.02a Hz. 


-For lowpass signals, the essential bandwidth may also be defined as a frequency at which the 
value of the amplitude spectrum is a small fraction (about 1%) of its peak value. In Example 4.16, 
for instance, the peak value, which occurs at w = 0, is 1/a. 
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Suppression of all the spectral components of f(t) beyond the essential band- 
width results in a signal f (t), which is a close approximation of f(t). If we use the 
95% criterion for the essential bandwidth, the energy of the error (the difference) 
f(t) — f(t) is 5% of Ey. 


Energy Spectral Density From Autocorrelation Function 


Correlation of a function f(t) with itself is its autocorrelation function 
w(t), which, for a real f(t), is given by [see Eq. (3.32)} 


os(t) = T f(z)f(z — t)dz (4.68a) 
Also, from Eq. (3.31) with g(t) = f(t), it follows that 
slt) = F(t) * f(-t) (4.68b) 


From Eq. (4.68b) it is clear that 


b5(—t) = f(—t) * f(t) = v(t) 
Therefore, for real f(t), autocorrelation function w(t) is an even function of t. The 
Fourier transform of Eq. (4.68b) yields 


y(t) = |F(w)/? (4.69) 
Therefore, the Fourier transform of the autocorrelation function is its energy spec- 
tral density |F (w)|?. It is clear that #(t) provides the spectral information of f(t) 
directly. 

The direct link of the autocorrelation function to the spectral information can 
be explained intuitively as follows. The autocorrelation function #;(t) is the corre- 
lation of a signal with itself delayed by ¢ seconds. A signal f(t) correlates perfectly 
with itself with zero delay. But as the delay increases, the similarity decreases. 
Thus, the autocorrelation function w(t) is a nonincreasing function of t. If f(t) 
is a slowly varying signal (low frequency signal), it changes slowly with t. Conse- 
quently such a signal will show considerable similarity or correlation with itself even 
for relatively large delay. The autocorrelation function Y(t) decays slowly with t 
and has a larger width. On the other hand, for a rapidly varying signal, the signal 
similarity will decrease rapidly with delay ¢ and ~;(t) has a smaller width. Thus, 
the shape of y(t) has a direct link to spectral information of f(t). 


4.7 Application to Communications: Amplitude Modulation 


Modulation causes a spectral shift in a signal and is used to gain certain ad- 
vantages mentioned in Sec. 4.3-5. Broadly speaking, there are two classes of modu- 
lation: amplitude (linear) modulation and angle (nonlinear) modulation, which are 
the subject of the next two sections. In this section, we shall discuss some practical 
forms of amplitude modulation. 


4.7-1 Double Sideband, Suppressed Carrier (DSB-SC) Modulation 


In amplitude modulation, the amplitude A of the carrier A cos (wet + 8e) is 
varied in some manner with the baseband (message)} signal m(t) (known as the 


{The term baseband is used to designate the band of frequencies of the signal delivered by the 
source or the input transducer. 
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Fig. 4.31 DSB-SC modulation. 


modulating signal). The frequency we and the phase 6, are constant. We can as- 
sume ĝe = 0 without a loss of generality. If the carrier amplitude A is made directly 
proportional to the modulating signal m(t), the modulated signal is m(t) cos wet 
(Fig. 4.31a). As was indicated earlier [Eq. (4.41)], this type of modulation simply 
shifts the spectrum of m(t) to the carrier frequency (Fig. 4.31c). Thus, if 


m(t) ==> M (w) 
then 1 
m(t) cos wet => zM +w) +M (w — we) (4.70) 


Recall that M (w — we) is M (w) shifted to the right by wo and M (w + we) is M (w) 
shifted to the left by we. Thus, the process of modulation shifts the spectrum of the 
modulating signal to the left and the right by we. Note also that if the bandwidth 
of m(t) is B Hz, then, as indicated in Fig. 4.31c, the bandwidth of the modulated 
signal is 2B Hz. We also observe that the modulated signal spectrum centered 
at we is composed of two parts: a portion that lies above we, known as the upper 
sideband (USB), and a portion that lies below wc, known as the lower sideband 
(LSB). Similarly, the spectrum centered at —w, has upper and lower sidebands. 
This form of modulation is called double sideband (DSB) modulation for obvious 
reason. 
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The relationship of B to we is of interest. Figure 4.31c shows that w, > 27B in 
order to avoid the overlap of the spectra centered at twe. If we < 27B, the spectra 
overlap and the information of m(t) is lost in the process of modulation, a loss which 


makes it impossible to get back m(t) from the modulated signal m(t) cos wet.t 


a Example 4.17 


For a baseband signal m(t) = cos wmt, find the DSB signal, and sketch its spectrum. 
Identify the upper and lower sidebands. 


We shall work this problem in the frequency-domain as well as the time-domain 
in order to clarify the basic concepts of DSB-SC modulation. In the frequency-domain 
approach, we work with the signal spectra. The spectrum of the baseband signal m(t) = 
COS Wmt is given by 


M(w) = 2[6(w — wm) + 6(w + wm)] 


The spectrum consists of two impulses located at twm, as depicted in Fig. 4.32a. The 
DSB-SC (modulated) spectrum, as indicated by Eq. (4.70), is the baseband spectrum in 
Fig. 4.32a shifted to the right and the left by we (times one-half), as depicted in Fig. 4.32b. 
This spectrum consists of impulses at +(we—wWm) and +(we+wm). The spectrum beyond 
we is the upper sideband (USB), and the one below w is the lower sideband (LSB). Observe 
that the DSB-SC spectrum does not have the component of the carrier frequency we. This 
is why it is called double sideband-suppressed carrier (DSB-SC) . 


M (w) 


USB 
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Fig. 4.32 An example of DSB-SC modulation. 


In the time-domain approach, we work directly with signals in the time-domain. For 
the baseband signal m(t) = cos wmt, the DSB-SC signal Ypss-sc (t) is 


Ypsp.sc(t) = m(t) cos wet 


= COS Wmt COS Wet 


5 [eos (we + Wm)t + cos (We — Wm)t] (4.71) 


{Practical factors may impose additional restrictions on we. For instance, in broadcast appli- 
cations, a radiating antenna can radiate only a narrowband without distortion. This restriction 
implies that to avoid distortion caused by the radiating antenna, w./27B >> 1. The broadcast 
band AM radio, for instance, with B = 5 kHz and the band of 550 to 1600 kHz for carrier frequency 
give a ratio of wc/27 B roughly in the range of 100 to 300. 
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This result shows that when the baseband (message) signal is a single sinusoid of frequency 
wm, the modulated signal consists of two sinusoids: the component of frequency we + wm 
(the upper sideband), and the component of frequency we—wm (the lower sideband). Figure 
4.32b illustrates precisely the spectrum of Ypss-.sc (t). Thus, each component of frequency 
wm in the modulating signal results into two components of frequencies we + wm and 
We — Wm in the modulated signal. This being a DSB-SC (suppressed carrier) modulation, 
there is no component of the carrier frequency we on the right-hand side of the above 


equation as expected.t 
Lowpass filter 


(a) Demodulator 


+ me) 


m(t)cos Ot 


(b) Spectrum of e(1) 


Fig. 4.33 Demodulation of DSB-SC. 


Demodulation of DSB-SC Signals 


The DSB-SC modulation translates or shifts the frequency spectrum to the 
left and the right by we (that is, at +w, and —w,), as seen from Eq. (4.70). To 
recover the original signal m(t) from the modulated signal, we must retranslate the 
spectrum to its original position. The process of recovering the signal from the 
modulated signal (retranslating the spectrum to its original position) is referred to 
as demodulation, or detection. Observe that if the modulated signal spectrum 
in Fig. 4.31c is shifted to the left and to the right by we (and halved), we obtain the 
spectrum illustrated in Fig. 4.33b, which contains the desired baseband spectrum 
in addition to an unwanted spectrum at +2w,. The latter can be suppressed by a 
lowpass filter. Thus, demodulation, which is almost identical to modulation, consists 
of multiplication of the incoming modulated signal m(t) cos wet by a carrier cos wet 
followed by a lowpass filter, as depicted in Fig. 4.33a. We can verify this conclusion 
directly in the time-domain by observing that the signal e(t) in Fig. 4.33a is 


[m(t) + m(t) cos 2wet] (4.72a) 


{The term suppressed carrier does not necessarily mean absence of the spectrum at the carrier 
frequency. The term “suppressed carrier” merely implies that there is no discrete component of 
the carrier frequency. Since no discrete component exists, the spectrum of DSB-SC does not have 
impulses at +we, a fact which further implies that the modulated signal m(t) cos wet does not 
contain a term of the form kcos wet (assuming that m(t) has a zero mean value). 
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Therefore, the Fourier transform of the signal e(t) is 
1 1 
E(w) = gM lw) + 4M (w + Que) + M (w — Qwe)] (4.72b) 


Hence, e(t) consists of two components m(t) and #m/(t) cos 2wet, with their spec- 
tra, as illustrated in Fig. 4.33b. The spectrum of the second component, being 
a modulated signal with carrier frequency 2we, is centered at +2we. Hence, this 
component is suppressed by the lowpass filter in Fig. 4.33a. The desired component 
4M (w), being a lowpass spectrum (centered at w = 0), passes through the filter 
unharmed, resulting in the output 4m (t). 

A possible form of lowpass filter characteristics is depicted (dotted) in Fig. 4.33b. 
This method of recovering the baseband signal is called synchronous detection, 
or coherent detection, where we use a carrier of exactly the same frequency (and 
phase) as the carrier used for modulation. Thus, for demodulation, we need to gen- 
erate a local carrier at the receiver in frequency and phase coherence (synchronism) 
with the carrier used at the modulator. We shall demonstrate in Example 4.18 that 
both, the phase and frequency synchronism, are extremely critical. 


Eu Example 4.18 
Discuss the effect of lack of frequency and phase coherence (synchronism) between 
the carriers at the modulator (transmitter) and the demodulator (receiver) in DSB-SC. 
Let the modulator carrier be cos wet (Fig. 4.31a). For the demodulator in Fig. 4.33a, 
we shall consider two cases: (1) the first case with carrier cos (wet + 0) (phase error of 0) 
and (2) the second case with carrier cos (we + Aw)t (frequency error Aw). 


(a) With the demodulator carrier cos (wet + 0) (instead of cos wet) in Fig. 4.33a, the 
multiplier output is e(t) = m(t) cos wet cos (wet + 8) instead of m(t)cos* wet. Using the 
trigonometric identity, we obtain 


e(t) = m(t) cos wet cos (wet + 9) 


3 sm(t)[cos 8 + cos (2wet + 0) 


The spectrum of the component 4m(t) cos (Quct + 8) is centered at +2we. Consequently, 
it will be filtered out by the lowpass filter at the output. The component m(t) cos 6 
is the signal m(t) multiplied by a constant 3 cos 6. The spectrum of this component is 
centered at w = 0 (lowpass spectrum), and will pass through the lowpass filter at the 
output, yielding the output m(t) cos @. 

If 6 is constant, the phase asynchronism merely yields an attenuated output (by a 
factor cos 0). Unfortunately, in practice, 8 is often the phase difference between the carriers 
generated by two distant generators, and varies randomly with time. This variation would 
result in an output whose gain varies randomly with time. 


(b) In the case of frequency error, the demodulator carrier is cos (we + Aw)t. This 
situation is very similar to the phase error case in (a) with 8 replaced by (Aw)t. Following 
the analysis in part (a), we can express the demodulator product e(t) as 


e(t) = m(t) cos wet cos (we + Aw)t 
1 


= gm(t)[cos (Aw)t + cos (2w: + Aw)t] 
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The spectrum of the component }m/(t) cos (2w: + Aw)t is centered at +(2we + Aw). Con- 
sequently, this component will be filtered out by the lowpass filter at the output. The 
component 3m(t)cos(Aw)¢ is the signal m(t) multiplied by a low frequency carrier of 
frequency Aw. The spectrum of this component is centered at tAw. In practice, the 
frequency error (Aw) is usually very small. Hence, the signal m(t) cos (Aw)t (whose 
spectrum is centered at +Aw) is a lowpass signal and passes through the lowpass filter at 
the output, resulting in the output }m(t)cos(Aw)t. The output is the desired signal m(t) 
multiplied by a very low frequency sinusoid cos(Aw)t. Clearly, the output in this case is 
not merely an attenuated replica of the desired signal m(t), but represents m(t) multiplied 
by a time-varying gain cos (Aw)t. If, for instance, the transmitter and the receiver carrier 
frequencies differ just by 1 Hz, the output will be the desired signal m(t} multiplied by 
a time-varying signal whose gain goes from the maximum to 0 every half second. This 
is like some restless child fiddling with the volume control knob of a receiver, going from 
maximum volume to zero volume every half second. This kind of distortion (called the 
beat effect) is beyond repair. 


4.7-2 Amplitude Modulation (AM) 


For the suppressed carrier scheme just discussed, a receiver must generate a 
carrier in frequency and phase synchronism with the carrier at the transmitter that 
may be located hundreds or thousands of miles away. This situation calls for a 
sophisticated receiver, which could be quite costly. The other alternative is for 
the transmitter to transmit a carrier A cos wet [along with the modulated signal 
m(t) cos wet] so that there is no need to generate a carrier at the receiver. In this 
case the transmitter needs to transmit much larger power, a rather expensive pro- 
cedure. In point-to-point communications, where there is one transmitter for each 
receiver, substantial complexity in the receiver system can be justified, provided 
there is a large enough saving in expensive high-power transmitting equipment. On 
the other hand, for a broadcast system with a multitude of receivers for each trans- 
mitter, it is more economical to have one expensive high-power transmitter and 
simpler, less expensive receivers. The second option (transmitting a carrier along 
with the modulated signal) is the obvious choice in this case. This is the so-called 
AM (amplitude modulation), in which the transmitted signal y,,,(t) is given by 


Panu lt) = A cos wet + m(t) cos wet (4.73a) 
= [A + m(t)] cos wet (4.73b) 


Recall that the DSB-SC signal is m(t) cos wet. From Eq. (4.73b) it follows that 
the AM signal is identical to the DSB-SC signal with A + m(t) as the modulating 
signal [instead of m(t)]. Therefore, to sketch ,,,(t), we sketch A + m(t) and 
—[A+m(t)] and fill in between with the sinusoid of the carrier frequency. Two cases 
are considered in Fig. 4.34. In the first case, A is large enough so that A+m(t) > 0 
(is nonnegative) for all values of ¢. In the second case, A is not large enough to 
satisfy this condition. In the first case, the envelope (Fig. 4.34d) has the same shape 
as m(t) (although riding on a dc of magnitude A). In the second case the envelope 
shape is not m(t), for some parts get rectified (Fig. 4.34e). Thus, we can detect 
the desired signal m(t) by detecting the envelope in the first case. In the second 
case, such a detection is not possible. We shall see that the envelope detection is 
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Fig. 4.34 AM signal and its envelope. 


an extremely simple and inexpensive operation, which does not require generation 
of a local carrier for the demodulation. But as seen above the envelope of AM has 
the information about m(t) only if the AM signal [A + m(t)} cos wet satisfies the 
condition A + m(t) > 0 for all t. Thus, the condition for envelope detection of an 
AM signal is 


A+m(t)>0 forall t (4.74) 
If mp is the peak amplitude (positive or negative) of m(t) (see Fig. 4.34), then 
m(t) > —mp. Hence, the condition (4.74) is equivalent tot 

A>mp (4.75) 


Thus the minimum carrier amplitude required for the viability of envelope detection 
is mp. This point is clearly illustrated in Fig. 4.34. 
We define the modulation index u as 


= 7r 
wan (4.76) 


tin case the negative and the positive peak amplitudes are not identical, mp in condition (4.75) 
is the absolute negative peak amplitude. 
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where A is the carrier amplitude. Note that mp is a constant of the signal m(t). 
Because A > mp and because there is no upper bound on A, it follows that 


O<n<l (4.77) 


as the required condition for the viability of demodulation of AM by an envelope 
detector. 

When A < mp, Eq. (4.76) shows that » > 1 (overmodulation). In this case, the 
option of envelope detection is no longer viable. We then need to use synchronous 
demodulation. Note that synchronous demodulation can be used for any value of 
u (see Prob, 4.7-4). The envelope detector, which is considerably simpler and less 
expensive than the synchronous detector, can be used only for u < 1. 


| Example 4.19 

Sketch y,,,(t) for modulation indices of u = 0.5 (50% modulation) and u = 1 (100% 
modulation), when m(t) = Bcos wmt. This case is referred to as tone modulation 
because the modulating signal is a pure sinusoid (or tone). 

In this case, mp = B and the modulation index according to Eq. (4.76) is 


-2 
PEA 


Hence, B = pA and 
m(t) = B cos wmt = pA cos wmt 


E E E easels E 
oe 


Fig. 4.35 Tone-modulated AM (a) p = 0.5. (b) p = 1. 


Figures 4.35a and b show the modulated signals corresponding to u = 0.5 and u = 1, 
respectively. 


Demodulation of AM: The Envelope Detector 
The AM signal can be demodulated coherently by a locally generated carrier 


(see Prob. 4.7-4). However, coherent, or synchronous, demodulation of AM (with 
p < 1) will defeat the very purpose of AM and, hence, is rarely used in practice. 
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Fig. 4.36 Envelope detector. 


We shall consider here one of the noncoherent methods of AM demodulation, the 
envelope detection. 

In an envelope detector, the output of the detector follows the envelope of the 
(modulated) input signal. The circuit illustrated in Fig. 4.36a functions as an en- 
velope detector. During the positive cycle of the input signal, the diode conducts 
and the capacitor C charges up to the peak voltage of the input signal (Fig. 4.36b). 
As the input signal falls below this peak value, the diode is cut off, because the 
capacitor voltage (which is very nearly the peak voltage) is greater than the input 
signal voltage, a circumstance causing the diode to open. The capacitor now dis- 
charges through the resistor R at a slow rate (with a time constant RC). During 
the next positive cycle, the same drama repeats. When the input signal becomes 
greater than the capacitor voltage, the diode conducts again. The capacitor again 
charges to the peak value of this (new) cycle. As the input voltage falls below the 
new peak value, the diode cuts off again and the capacitor discharges slowly during 
the cutoff period, a process that changes the capacitor voltage very slightly. 


{There are also other methods of noncoherent detection. The rectifier detector consists of a rectifier 
followed by a lowpass filter. This method is also simple and almost as inexpensive as the envelope 
detector*. The nonlinear detector, although simple and inexpensive, results in a distorted output. 
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In this manner, during each positive cycle, the capacitor charges up to the peak 
voltage of the input signal and then decays slowly until the next positive cycle. 
Thus, the output voltage vc(t) follows the envelope of the input. The capacitor 
discharge between positive peaks, however, causes a ripple signal of frequency we 
in the output. This ripple can be reduced by increasing the time constant RC so 
that the capacitor discharges very little between the positive peaks (RC < 1/w,). 
Making RC too large, however, would make it impossible for the capacitor voltage 
to follow the envelope (see Fig. 4.36b). Thus, RC should be large compared to 
1/w_ but should be small compared to 1/27B, where B is the highest frequency in 
m{t). Incidentally, these two conditions also require that we >> 27B, a condition 
necessary for a well-defined envelope. 

The envelope-detector output vc(t) is A + m(t) plus a ripple of frequency we. 
The dc term A can be blocked out by a capacitor or a simple RC highpass filter. 
The ripple may be reduced further by another (lowpass) RC filter. In the case 
of audio signals, the speakers cannot respond to the high frequency ripple, and 
therefore, they act as lowpass filters themselves. 


4.7-3 Single Sideband Modulation (SSB) 


Figures 4.37a and 4.37b show the baseband spectrum M (w), and the spectrum 
of the DSB-SC modulated signal m(t) cos wet. The DSB spectrum in Fig. 4.37b 
has two sidebands: the upper sideband (USB) and the lower sideband (LSB), both 
containing complete information of M (w) [see Eq. (4.10)]. Clearly, it is redundant 
to transmit both sidebands, a process which requires twice the bandwidth of the 
baseband signal. A scheme where only one sideband is transmitted is known as sin- 
gle sideband (SSB) transmission, which requires only one-half the bandwidth 
of the DSB signal. Thus, we transmit only the upper sidebands (Figures 4.37c) or 
only the lower sidebands (Fig. 4.37d). 

An SSB signal can be coherently (synchronously) demodulated. For example, 
multiplication of a USB signal (Fig. 4.37c) by cos wet shifts its spectrum to the left 
and to the right by we, yielding the spectrum in Fig. 4.37e. Lowpass filtering of 
this signal yields the desired baseband signal. The case is similar with LSB signal. 
Hence, demodulation of SSB signals is identical to that of DSB-SC signals, and the 
synchronous demodulator in Fig. 4.33a can demodulate SSB signals. Note that we 
are talking of SSB signals without an additional carrier. Hence, they are suppressed 
carrier signals (SSB-SC). 


E Example 4.20 

Find the USB (the upper sideband) and LSB (the lower sideband) signals when 
m(t) = cos wmt. Sketch their spectra, and show that these SSB signals can be demodulated 
using the synchronous demodulator in Fig. 4.33a. 

The DSB-SC signal for this case is 


Pose-sc lt) = m(t) cos wet 
= COS Wmt COS Wet 
leos (we — wm )t + cos (we + wm)t] (4.79) 


As pointed out in Example 4.17, the terms 3 cos (we + wm)t and 4 cos (we — wm)t 
represent the upper and lower sidebands, respectively. Figure 4.38a and b show the spectra 
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Fig. 4.37 Single sideband transmission. 
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Fig. 4.38 Single sideband spectra for m(t) = cos wmt. 


of the upper and lower sidebands. Observe that these spectra can be obtained from the 
DSB-SC spectrum in Fig. 4.32b by suppressing the undesired sidebands using a proper 
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filter. For instance, the USB signal in Fig. 4.38a can be obtained by passing the DSB-SC 
signal (Fig. 4.32b) through a highpass filter of cutoff frequency we. Similarly, the LSB 
signal in Fig. 4.38b can be obtained by passing the DSB-SC signal through a lowpass filter 
of cutoff frequency we. 

If we apply the LSB signal 3 cos (We — wm)t to the synchronous demodulator in 
fig. 4.33a, the multiplier output is 


e(t) = + cos (We ~ Wm)t cos wet 


= Fleas wmt + cos (2we — Wm)t] 


The term + cos (2wWe — wm }t is suppressed by the lowpass filter, a fact which results in the 
desired output 4 cos wmt (which is m(t)/4). The spectrum of this term is 1[5(w + wo) + 
(w —wo)]/4, as depicted in Fig. 4.38c. In the same way we can show that the USB signal 
can be demodulated by the synchronous demodulator. 

In frequency-domain, demodulation (multiplication by cos wet amounts to shifting the 
LSB spectrum (Fig. 4.38b) to the left and the right by wec (times one-half) and then sup- 
pressing the high frequency, as illustrated in Fig. 4.38c. The resulting spectrum represents 
the desired signal }m(t). 
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Fig. 4.39 Voice Spectrum. 
Generation of SSB Signals 


Two methods are commonly used to generate SSB signals. The first method, 
the selective-filtering method uses sharp cutoff filters to eliminate the undesired 
sideband, and the second method uses phase-shifting networks* to achieve the same 
goal.t We shall consider here only the first method. 

The selective-filtering Method is the most commonly used method of generating 
SSB signals. In this method, a DSB-SC signal is passed through a sharp cutoff filter 
to eliminate the undesired sideband. 

To obtain the USB, the filter should pass all components above we unattenuated 
and completely suppress all components below we. Such an operation requires an 
ideal filter, which is unrealizable. It can, however, be realized closely if there is 
some separation between the passband and the stopband. Fortunately, the voice 
signal provides this condition, because its spectrum shows little power content at 
the origin (Fig. 4.39). Moreover, articulation tests show that for speech signals, 
frequency components below 300 Hz are not important. In other words, we may 
suppress all speech components below 300 Hz without affecting the intelligibility 


TYet another method, known as Weaver’s method, is also used to generate SSB signals. 
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appreciably.t Thus, filtering of the unwanted sideband becomes relatively easy 
for speech signals because we have a 600 Hz transition region around the cutoff 
frequency we. For signals, which have considerable power at low frequencies (around 
w = 0), SSB techniques cause considerable distortion. Such is the case with video 
signals. Consequently, for video signals, instead of SSB, we use another technique, 
the vestigial sideband (VSB), which is a compromise between SSB and DSB. 
It inherits the advantages of SSB and DSB but avoids their disadvantages. VSB 
signals are relatively easy to generate, and their bandwidth is only slightly (typically 
25%) greater than that of the SSB signals. In VSB signals, instead of rejecting one 
sideband completely (as in SSB), we accept a gradual cutoff off of one sideband?. 


4.8 Angle Modulation 


A sinusoid is characterized by its amplitude and angle (which includes its fre- 
quency and phase). In amplitude modulated signals, the information content of the 
baseband (message) signal m(t) appears in the amplitude variations of the carrier. 
In angle modulation discussed in this section, the information content of m (t) 
is carried by the angle of the carrier. Angle modulation also goes by the name 
exponential modulation. 

The generalized angle modulated (or exponentially modulated) carrier can be 
described as 


Pem (t) = A cos [wet + ky(t)] (4.80) 


where k is an arbitrary constant and y(t), which is a measure of m(t), is obtained 
by an invertible linear operation on m(t). In other words, w(t) is the output of 
some linear system with a suitable transfer function H(s) when the input is m(t), 
as depicted in Fig. 4.40.t If h(t) is the unit impulse response of this system; that 
is, if h(t) = H (s), then 


m(t) vin) Angle Foal) 


Fig. 4.40 Generation of angle modulated signal. 


w= f m(a)h(t — a) da (4.81) 


By selecting suitable h(t), we can obtain a variety of subclasses of angle modula- 
tion. For instance, if we select h(t) = u(t), the resulting form is the well-known 
frequency modulation (FM). In contrast, use of A(t) = 6(t) leads to phase 
modulation (PM). These are but two of the infinite possibilities. Although in 


{Similarly, suppression of speech-signal components above 3500 Hz causes no appreciable change 
in intelligibility. 

{Because H(s) is required to be invertible, we can obtain m(t) by passing y(t) through the inverse 
linear system, which has the transfer function 1/H(s). 
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digital communication, use of phase and frequency modulation is common, the so- 
called broadcast FM is not FM in the classical sense, but is a generalized angle 
modulation because of the inclusion of the preemphasis filter used to improve its 
noise suppressing abilities. It is called FM for historical reason in the sense that 
angle modulation was first conceived and introduced in the form of frequency mod- 
ulation. The broadcast FM, although originating as true FM in the laboratories, 
was modified in broadcasting for better performance. Yet, the term FM continued 
to be used to describe this scheme. 

In amplitude modulation, the carrier frequency is constant, but the amplitude 
changes with m/(t). In contrast, in angle modulation, the carrier amplitude is always 
constant, but the carrier frequency varies continuously with the message m(t). By 
definition, a sinusoidal signal is expected to have a constant frequency; hence, the 
variation of frequency with time appears to be contradictory to the conventional 
definition of a sinusoidal signal frequency. Therefore, we must generalize the notion 
of a sinusoid so as to make allowance for variation of frequency with time. This 
generalization leads us to a new concept of instantaneous frequency. 


Fig. 4.41 Concept of instantaneous frequency. 


4.8-1 The Concept of Instantaneous Frequency 


As seen above, the carrier frequency is changing continuously every instant in 
FM. Prima facie, this does not make much sense because to define a frequency, we 
must have a sinusoidal signal at least over one cycle with the same frequency. We 
cannot imagine a sinusoid whose frequency is different at every instant. This prob- 
lem reminds us of our first encounter with the concept of instantaneous velocity 
in our beginning mechanics course. Until that time, we were used to thinking of 
velocity as being constant over a time interval and were incapable of even imagining 
that velocity could vary at each instant. But after some mental struggle, the idea 
gradually sinks in. We never forget, however, the wonder and amazement that was 
caused by the idea when it was first introduced. A similar experience awaits the 
reader with the concept of instantaneous frequency. 

Let us consider a generalized sinusoidal signal y(t) given by 
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y(t) = Acos 6(t) (4.82) | 


where (t), the generalized angle, is a function of t. Figure 4.41 illustrates 
a hypothetical case of @(t). The generalized angle for a conventional sinusoid 
Acos (wet + ġo) iS wet + ġo. This plot, a straight line with a slope we and in- 
tercept ¢o, is also illustrated in Fig. 4.41. The plot of 9(t) for the hypothetical case 
happens to be tangential to the angle (wet +.) at some instant t. The crucial point 
is that over a small interval At — 0, the signal y(t) = A cos @(t) and the sinusoid 
Acos (wet + ġo) are identical; that is, 


p(t) = A cos (wet + $o) ty < t< te 


We are certainly justified in saying that over this small interval At, the frequency 
of y(t), is we Because (wet + ġo) is tangential to 0 (t), the frequency of y(t) is the 
slope of its angle @(t) over this small interval. We can generalize this concept at 
every instant and say that the instantaneous frequency w; at any instant t is the 
slope of 6(t) at t. Thus, for y(t) in Eq. (4.82), the instantaneous frequency w(t) is 
given by 


wi(t) = z (4.83a) 
e(t) = [ wi(a) da (4.83b) 


For a conventional sinusoid A cos (wet + $o), we have O(t) = wet + $o, and u(t) = 
d6(t)/dt = we, a constant, as desired. Clearly, the generalized definition of instan- 
taneous frequency does not conflict with our old notion of frequency. 

Now we can see the possibility of transmitting the information of m(t) by 
varying the angle 8 of a carrier. Two simple possibilities are phase modulation 
(PM) and frequency modulation (FM). In PM, the angle 6(t) is varied linearly 
with m(t) : 

O(t) = wet + kpm(t) (4.844) 


where kp is a constant and we is the carrier frequency. The resulting PM wave is 


Ppu (t) = A cos [wet + kpm(t)| (4.84b) 
The instantaneous frequency w;(t) in this case is given by 
dé ; 
wi(t) = u + kpm(t) (4.84c) 


Hence in phase modulation, the instantaneous frequency w; varies linearly with the 
derivative of the modulating signal. If the instantaneous frequency w; is varied 
linearly with the modulating signal, we have frequency modulation. Thus, in FM, 
the instantaneous frequency w; is 


wilt) = we + kgm(t) (4.85a) 


where ky is a constant. From Eq. (4.83b), we find the angle 6(¢) as 
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a(t) = f [we + kjm(a)] da 


t 
=wet + ky J m(a) da (4.85b) 
~oo 


Here we have assumed the constant term in 4(t) to be zero without loss of generality, 
Thus, the FM wave is 


t 
Pru (t) = A cos [os + f 


=00 


m(a) da] (4.85c) 


Observe that both PM and FM are special cases of the exponentially modulated 
signal ~,,,(t) in Eq. (4.80). If A(t) = 6(t) in Eq. (4.81), then use of the sampling 
property of the impulse in Eq. (4.81) yields p(t) = m(t), and Eq. (4.80) reduces to 
PM in Eq. (4.84b). Similarly, if h(t) = u(t), then the fact that u(t — a) = 1 over 
-œ < a < t yields {m(a)h(t—a)da = fm(a)da, and Eq. (4.80) reduces to FM 
in Eq. (4.85c). 
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Fig. 4.42 Phase and frequency modulation are inseparable. 


All In The Family 


Equations (4.84b) and (4.85c) indicate that PM and FM are not only very 
similar but are inseparable. Replacing m(t) in Eq. (4.84b) with f : m(a) da changes 
PM into FM. Thus, a signal that is an FM wave corresponding to m (t) is also the PM 
wave corresponding to f É m(a) da (Fig. 4.42a). Similarly, a PM wave corresponding 
to m(t) is the FM wave corresponding to m(t) (Fig. 4.42b). 

We conclude that just by looking at an angle-modulated carrier, we cannot 
tell whether it is FM or PM. In fact, it is meaningless to enquire if a certain angle 
modulated wave is FM or PM. An analogous situation would be to ask a person 
(who is married, with children), whether he is a father or a son. The person would 
be puzzled because he is both, a father (of his child) and a son (of his father). 
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We have seen that PM and FM are not different kind of modulation, but two » 
special cases of generalized angle modulation. Such a view is very fruitful because 
it shows the convertibility of one type of angle modulation (such as PM) to another 
(such as FM). This convertibility is quite clear in Fig. 4.42. For instance, we show 
later that the bandwidth of FM is approximately 2kfmp, where Mp is the peak 
amplitude of m(t). We can derive the equivalent result for PM by referring to 
Fig. 4.42b, which shows that PM is actually the FM when the modulating signal 
is m(t). Clearly, the bandwidth of PM is approximately 2kpmp’, where my’ is the 
peak amplitude of m(t). This argument shows that if we analyze one type of angle 
modulation (such as FM), we could readily extend those results to any other kind. 
Historically, the angle modulation concept began with FM. Hence, it is customary 
to analyze FM and then modify those results for other forms, such as PM. But this 
does not imply that FM is superior to other kinds of angle modulation. On the 
contrary, PM is superior to FM for most analog signals such as audio and video. 
Actually, the optimum performance is realized neither by PM nor FM, but by some 
other form, depending on the nature of the baseband (message) signal. 


This discussion also shows that we need not discuss methods of generation and 
demodulation of each type of modulation. Figure 4.42 clearly indicates that the PM 
can be generated by an FM generator, and the FM can be generated by a PM gener- 
ator. One of the methods of generating FM in practice (the Armstrong indirect-FM 
system) actually integrates m(t) and uses it to phase-modulate a carrier. Similar 
remarks apply to demodulation of FM and PM. 


mÒ k— 2x 107* — m(t) 
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Fig. 4.43 FM and PM waveforms. 


E Example 4.21 


Sketch FM and PM waves for the modulating signal m(t) depicted in Fig. 4.43a. The 


constants ks and kp are 2n(10°) and 107, respectively, and the carrier frequency Fe is 
100 MHz. 
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For FM [see Eq. (4.85a)] 
Wi = we + kfm(t). Dividing throughout by 27, we obtain the equation in terms of 
the variable F (frequency in Hz). The instantaneous frequency F; is 


Fi = Fe + P(t) = 10° + 10°m(t) 


(Fi) min = 108 — 10° |[m(t)]min] = 99.9 MHz 
(Fi)max = 108 + 10°[m(t)]max = 100.1 MHz 


Because m(t) increases and decreases linearly with time, the instantaneous frequency in- 
creases linearly from 99.9 to 100.1 MHz over a half-cycle and decreases linearly from 100.1 
to 99.9 MHz over the remaining half-cycle of the modulating signal (Fig. 4.43b). 


For PM 
PM for m(t) is FM for m(t). This assertion also follows from Eq. (4.84c) or Fig. 
4.42b. 


ee Fe mle) = 10° +5 m(t) 
(Fi)min = 10° — 5 |[rn(t})]min| = 108 — 10° = 99.9 MHz 
(Fi)max = 10° + 5 [rn(t)] max = 100.1 MHz 


Because m(t) switches back and forth from a value of —20,000 to 20,000, the carrier 
frequency switches back and forth from 99.9 to 100.1 MHz every half-cycle of m(t), as 
illustrated in Fig. 4.43d. 

This indirect method of sketching PM (using m(t) to frequency-modulate a carrier) 
works as long as m(t) is a continuous signal. If m(t) is discontinuous, m(t) contains 
impulses, and this method is not so convenient. In such a case, a direct approach should 
be used. This is demonstrated in the next example. W 


{a) (c) 


99.9 MHz 100.1 MHz : 100 MHz 


LAA ha 
HHT 


(b) (d) 
Fig. 4.44 FM and PM waveforms. 


@ Example 4.22 
Sketch FM and PM waves for the digital modulating signal m(t) depicted in Fig. 4.44a. 
The constants ky and kp are 27(10°) and 1/2, respectively, and Fe = 100 MHz. 
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For FM 
Fi=Fet+ EL m(t) = 10° + 10°m(t) z 


Because m(t) switches back and forth from 1 to —1 and vice versa, the FM wave frequency 
switches back and forth from 99.9 MHz to 100.1 MHz and vice versa, as shown in Fig. 4.44b. 
This scheme of a carrier frequency modulation by a digital signal is known as frequency- 
shift keying (FSK), because the information digits are transmitted by shifting the carrier 
frequency. 


For PM A í 
eS Kf ay) — 198 4 Ly 
Fi = Fe + strn(t) = 10° + rlt) 


The derivative rh(t) = 0 everywhere except for impulses of strength +2 at the points of 
discontinuities of m(t) (Fig. 4.44c). This fact means the carrier frequency is Fẹ = 100 
MHz everywhere except at the points of discontinuities, where it changes momentarily by 
infinite amount. It is not immediately apparent how an instantaneous frequency can be 
changed by an infinite amount and then changed back to the original frequency in zero 
time. Let us consider the direct approach. 


Prum (t) = Acos [wet + kpm(t)} 


= Acos [uct + zme] 


when m(t) = —1 


A sin wet 
—A sin wet when m(t) =1 
This PM wave, illustrated in Fig. 4.44c, has the same frequency F, = 100 MHz everywhere. 
However, there are phase discontinuities of 7 radians at the instants where impulses of m(t) 
are located. At these instants, the carrier phase shifts by m instantaneously. A finite phase 
shift in zero time implies infinite instantaneous frequency (d0/dt = co) at these instants. 
This conclusion agrees with our observation about m(t). 

This scheme of carrier phase modulation by a digital signal is called phase-shifting 
keying (PSK), because information digits are transmitted by shifting the carrier phase. 
Note that PSK may also be viewed as a DSB-SC modulation by m(t). 

The amount of phase discontinuity in Ypy (t) at the instant where m(t) is discontin- 
uous is kpma, where ma is the amount of discontinuity in m(t) at that instant. In the 
present example, the amplitude of m(t) changes by 2 (from —1 to 1) at the discontinuity. 
Hence, the phase discontinuity in Ypy (t) is kyma = 3 (2) =m radians, which confirms our 
earlier result. 

When m(t) is a digital signal (as in Fig. 4.44a), Ypy (t) shows a phase discontinuity 
where m(t) has a jump discontinuity. In such a case the phase deviation kpm(t) must be 
restricted to a range (—7, 7) in order to avoid ambiguity in demodulation. For example, 
if kp were 37/2 in the present example, then 


Yeu (t) = A cos [vet + Z mit) 


In this case y,,,(t) = Asin wet when m(t) = 1 or —1/3. This will certainly cause ambi- 
guity at the receiver when Asin wet is received. Such ambiguity never arises if kpm(t) is 
restricted to the range (—7, 7). 

The ambiguity arises only when m(t) has jump discontinuities. In such a case, the 
phase of ppu (t) changes instantaneously. Because a phase po + 2nzm is indistinguishable 
from the phase yo, ambiguities will be inherent in the demodulator unless the phase 
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variations are limited to the range (—7, r). For this reason kp should be small enough to 
restrict the phase change kpm(t) to the range (—7, 7). 

No such restriction on kp is required if m(t) is continuous. In this case the phase 
change is not instantaneous, but gradual over a time, and a phase po + 2nz will exhibit 
n additional carrier cycles over the case of phase of only yo. This conclusion can also be 
verified from Example 4.21, where the maximum phase change Ay = 10r. 

Because a bandlimited signal cannot have jump discontinuities, we can say that when 
m(t) is bandlimited, kp has no restrictions. [i 


4.8-2 Bandwidth of Angle-Modulated Signals 


Unlike amplitude modulation, there is no simple relationship between the base- 
band signal waveform and the corresponding angle modulated waveform. The same 
is true of their spectra. Because of nonlinear nature of angle modulation, derivation 
of &,,,(w), the frequency spectrum of the modulated signal is extremely compli- 
cated and can be obtained only for few special cases. Generally, the bandwidth of 
an angle modulated signal is infinite even when the baseband signal bandwidth is 
finite. However, most of the signal power (or energy) resides in a finite band. We 
shall now try to estimate this essential bandwidth of an angle modulated signal. 

Let us start with the angle modulated signal in Eq. (4.80), and consider first 
the case of small k (k — 0). 


Pum lt) = A cos [wet + ky(t)] 
= Á cos wet cos [ky (t)] — A sin wet sin [kp (t)] 
= ACOS wet — Akw(t) sin wet k30 (4.86) 


Comparison of the right-hand side expression with »,,,(¢) in Eq. (4.73a) shows 
that the two expressions are very similar. The first term is the carrier, and the 
second term, representing the sidebands, has the same form as the DSB-SC signal 
corresponding to the baseband signal Aky(t). The only difference is that the carrier 
is sine instead of cosine. This is just a matter of carrier phase difference of 1/2. 
Hence, the bandwidth of the angle modulated signal is the same as that of AM 
signal corresponding to the baseband signal y(t). If m(t) is bandlimited to B Hz, 
then the bandwidth of y(t) is also B Hz.t Hence, the bandwidth of ,,,(t) is 2B 
Hz, the same as that of AM. But this true only when k — 0. Let us now consider 
the general case. 

In angle modulation, the carrier frequency is varied from its quiescent value 
we. Let the maximum deviation of the carrier frequency be Aw. In other words, 
the carrier frequency varies in the range from we — Aw to we + Aw. Because the 
carrier frequency always remains in this band of width 2Aw radians/s, could we say 
that the resulting spectrum also remains within this band and the bandwidth of 
the angle modulated signal is 2Aw? This assertion implies that if a sinusoid takes 
an instantaneous frequency wg , the resulting spectrum is concentrated only at wz. 
This is true only if the carrier has infinite duration. For a finite duration sinusoid of 


{Because y(t) is the output of a linear system when the input is m(t), the bandwidth of (t) 
cannot be greater than B Hz. Moreover, the filter is invertible. Hence, the filter bandwidth 
cannot be less than B Hz, or some of the components of m(t) will be lost. So, the bandwidth of 
w(t) cannot be less than B Hz. Hence, it is exactly equal to B Hz. 
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frequency wz , the spectrum is not concentrated at wx , but spreads out on both sides 
of wz , as can be seen from Fig. 4.24d in Example 4.12. In a typical angle modulated 
signal, the carrier frequency is directly proportional to m(t), which changes with 
t. Hence, the instantaneous frequency will also change with t continuously. Such 
continuous shift in frequency will cause the spectral spread beyond the band 2Aw. 
Clearly, the bandwidth of the angle modulated signal is somewhat larger than 2Aw 
rads/s. How much larger? This missing link can be found by looking at the results 
derived earlier for the case of k — 0. Let us first determine Aw. 
From Eq. (4.80), it follows that 


wi(t) = we + k(t) (4.87) 


if the peak amplitude of y(t) is denoted by pp» then the carrier frequency varies in 
the range from we — ky, to we + kit Therefore 


Aw = ky, (4.88a) 


The carrier frequency deviation AF in Hz is 


Af = = y}, (4.88b) 


As demonstrated earlier, because of spectral spreading, the angle modulated signal 
bandwidth is somewhat larger than 2AF. Let the actual bandwidth Bgm in Hz be 


Bem = 2AF +X 
k 


where X is unknown. To determine X, recall that for the case k — 0, we found the 
bandwidth to be 2B. But as Eq. (4.89) indicates, this bandwidth is X when k > 0. 
Therefore, X = 2B, and 


Bem = 2(AF + B) Hz (4.90) 


A more rigorous derivation of this result appears in reference 4. Note that when 
k +0, AF — 0 and AF < B. On the other hand when k is very large, AF > B. 
The former case is known as the narrowband angle modulation and the latter is 
known as the wideband angle modulation. 

Recall that for FM, y(t) = m(t), and Y, = mp, where my is the peak amplitude 
of m(t). Similarly, for PM, y(t) = m(t). Hence, Y, = m}, where m; is the peak 
amplitude of m(t). Thus 


k 
(AF )pm = Amp and = (AF)py = Zm! (4.91) 


We observe an interesting fact in angle modulation. The bandwidth of the 
modulated signal is adjustable by choosing suitable value of AF or the constant k 
(ky in FM or kp in PM). Amplitude modulation lacks this feature. The bandwidth 
of each AM scheme is fixed. It is a general principle in communication theory 


{This assertion implies an assumption ab(t)|maz = [Olmin 
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that widening a signal bandwidth makes the signal more immune to noise during 
transmission. Thus, widening the transmission bandwidth makes angle modulated 
signals can be made more immune to noise. Moreover, this very property allows 
us to reduce the signal power required to achieve the same quality of transmission. 
Thus, angle modulation allows us to exchange signal power for bandwidth. 

Also, because of its constant amplitude, angle modulation has a major advan- 
tage over amplitude modulation. This feature makes angle modulation less suscep- 
tible to nonlinear distortion. We shall see in the following section (Sec. 4.8-3) that 
no distortion results when we pass an angle modulated signal through a nonlinear 
device whose output y(t) and the input x(t) are related by y(t) = z?(t} [in general 
y(t) = J anz”(t)]. Such a nonlinearity can be disastrous in amplitude modulated 
systems. This is the primary reason why angle modulation is used in microwave 
relay systems, where nonlinear operation of amplifiers and other devices has thus 
far been unavoidable at the required high power levels. In addition, the constant 
amplitude of FM gives it a kind of immunity against rapid fading. The effect of 
amplitude variations caused by rapid fading can be eliminated by using automatic 
gain control and bandpass limiting*. Angle modulation is also less vulnerable than 
amplitude modulation to small interference from adjacent channels. But the price 
for ali these advantages is paid in terms of increased bandwidth. We can demon- 
strate that for the same bandwidth, the pulse code modulation (PCM), discussed 
in Chapter 5, is superior to angle modulation‘. 


4.8-3 Generation and Demodulation of Angle Modulated Signals. 


In Eq. (4.86), we see that a narrowband angle (or exponential) modulated 
signal (NBEM) consists of a carrier term and a DSB-SC term whose carrier has 
a m/2 phase shift. Hence, we can readily generate this signal using the procedure 
discussed in Sec. 4.7. Wideband modulation (WBEM) can be obtained from NBEM 
by passing the NBEM signal through a nonlinear device. Consider, for example, a 
nonlinear device whose input z(t) and the output y(t) are related by y(t) = x(t). 
If the input is an angle modulated signal cos [wet + ky(t)], then the output y(t) is 
given by 


y(t) = cos? [wet + ky (t)] 
= ; + Zos [2wet + 2k4(t)] 


If we pass this signal through a bandpass filter centered at 2we, the output is 


saya Z cos wet + 2kw(t)] 


Observe that the second order of nonlinearity has doubled the carrier frequency as 
well as the effective value of k without causing any distortion. In a similar way, we 
can show that an nth-order of nonlinearity increases n-fold the carrier frequency 
as well as the effective value of k. This fact allows us the convert the NBEM into 
WBEM. This is the indirect method of generating angle modulated signal. 

We can also generate angle modulated signal by a direct method, which uses 
a voltage controlled oscillator (VCO). The output of a VCO is a constant 
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amplitude sinusoid, whose instantaneous frequency is directly proportional to an 
input voltage m(t). Clearly, a VCO is an FM generator. As demonstrated earlier, 
FM generator, with minor modification, can be used to generate any other form of 
angle modulation. 


Demodulation 


We shall discuss here demodulation of FM waves. As explained earlier, FM 
demodulator, with some minor modification, can be used for demodulation of any 
other form of angle modulation. Because the instantaneous frequency of FM wave 
is proportional to the baseband signal m(t), an FM demodulator is a device whose 
output is proportional to frequency of the input signal. Thus, the gain H(w) of 
an ideal FM demodulator is of the form ciw + c2. An ideal differentiator has 
this property. If the input to an ideal differentiator is an angle modulated signal 
z(t) = cos [wet + ky(t)], the output y(t) is given by 


dz(t) 


y(t) = a 


= — [we + kp (t)] sin [wet + ky (t)] 
= [we + kv (t)] sin wet + kb (t) + 7] 


The output is also an angle modulated signal, whose envelope is we + k(t). Hence, 
an ideal differentiator followed by an envelope detector will result in the output 
wet+kp(t). After blocking the dc, we obtain the desired output ký (t). Recall that for 
FM, y(t) = fi m(a)da. Hence, #(t) = m(t). Another device that can be used as an 
FM demodulator is a tuned circuit, whose resonant frequency is selected either above 
or below the carrier frequency of the FM signal to be demodulated. The frequency 
response of a tuned circuit (below the resonant frequency) is approximately linear 
with the input frequency (at least over a small band). This scheme suffers from 
the fact that the slope of H (w) of a tuned circuit is linear only over a small band, 
and therefore causes considerable distortion in the output. This fault can partially 
be corrected by a balanced discriminator that uses two resonant circuits, one tuned 
above and the other tuned below we. 

These days, a phase-locked loop (PLL), whose performance is superior to 
any of the methods discussed here (especially in the large noise environment) has 
become very popular as a demodulator of angle modulated signals because of its 
reasonable cost. More discussion about modulation and demodulation of angle 
modulated signals appears in reference 4. 


A Historical Note 


In the twenties, broadcasting was in its infancy. However, there was a constant 
search for techniques that would reduce noise (static). Now, since the noise power 
is proportional to the modulated signal bandwidth (sidebands), attempts were fo- 
cused on finding a modulation scheme to reduce the bandwidth. It was rumored 
that a new method had been discovered for eliminating sidebands (no sidebands, no 
bandwidth!). The concept of FM, where the carrier frequency would be varied in 
proportion to the message m(t), appeared quite intriguing. The carrier frequency 
w(t) would be varied with time so that w(t) = we + km({t), where k is an arbitrary 
constant. The carrier frequency will remain within the band from We — kmp to 
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we + kmp. The spectrum, centered at wc, would have a bandwidth 2kmy, which is 
controlled by the arbitrary constant k. By using an arbitrarily small k, we could 
make the information bandwidth arbitrarily small. This was a passport to com- 
munication heaven. Unfortunately, the experimental results showed that something 
was seriously wrong somewhere. The FM bandwidth was found to be always greater 
than (at best equal to) the AM bandwidth. In some cases, its bandwidth was several 
times that of AM. 

Careful analysis by Carson showed that the FM bandwidth could never be 
smaller than that of AM; at best equal to that of AM. Unfortunately, Carson did 
not recognize the compensating advantage of FM in its ability to suppress noise. 
Without any justification, he states, “Thus, FM introduces inherent distortion and 
has no compensating advantages whatsoever.” In his later paper he says: “In fact, 
as more and more schemes are analyzed and tested, and as the essential nature 
of the problem is clearly perceivable, we are unavoidably forced to the conclusion 
that static, like the poor, will always be with us.”® This opinion of one of the ablest 
mathematicians of the day in the communication industry set back the development 
of FM. The noise-suppressing advantage of FM was later proved by Major Edwin 
H. Armstrong’, a brilliant engineer whose contributions to the field of radio systems 
are comparable to those of Hertz and Marconi. It was largely the work of Armstrong 
that was responsible for rekindling the interest in FM. Lamentably, Armstrong, who 
became despondent over the lengthy, most acrimonious, and expensive court battles 
with some titans of the communication industry over his patent rights, committed 
suicide in 1954 by walking out of a window 13 stories above the street. 


4.8-4 Frequency-Division Multiplexing 


Signal multiplexing allows transmission of several signals on the same channel. 
In Chapter 5, we shall discuss time-division multiplexing (TDM), where several 
signals time-share the same channel, such as a cable or an optical fiber. In frequency- 
division multiplexing (FDM), the use of modulation, as illustrated in Fig. 4.45, 
makes several signals share the band of the same channel. Each signal is modulated 
by a different carrier frequency. The various carriers are adequately separated to 
avoid overlap (or interference) between the spectra of various modulated signals. 
These carriers are referred to as subcarriers. Each signal may use a different kind 
of modulation (for example, DSB-SC, AM, SSB-SC, VSB-SC, or even FM or PM). 
The modulated-signal spectra may be separated by a small guard band to avoid 
interference and facilitate signal separation at the receiver. 

When all of the modulated spectra are added, we have a composite signal that 
may be considered as a baseband signal. Sometimes, this composite baseband signal 
may be used to further modulate a high-frequency (radio frequency, or RF) carrier 
for the purpose of transmission. 

At the receiver, the incoming signal is first demodulated by the RF carrier to 
retrieve the composite baseband, which is then bandpass filtered to separate each 
modulated signal. Then each modulated signal is individually demodulated by an 
appropriate subcarrier to obtain all the basic baseband signals. 


4.9 Data Truncation: Window Functions 


We often need to truncate data in diverse situations from numerical computa- 
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Fig. 4.45 Frequency division multiplexing. 


tions to filter design. For example, if we need to compute numerically the Fourier 
transform of some signal, say e~*u(t), on a computer, we will have to truncate the 
signal e~*u(t) beyond a sufficiently large value of t (typically five time constants 
and above). The reason is that in numerical computations, we have to deal with 
data of finite duration. Similarly, the impulse response h(t) of an ideal lowpass 
filter is noncausal, and approaches zero asymptotically as |t| — oo. For a practical 
design, we may want to truncate h(t) beyond a sufficiently large value of |t| to make 
h(t) causal. In signal sampling, to eliminate aliasing, we need to truncate the signal 
spectrum beyond the half sampling frequency w,/2, using an anti-aliasing filter. 


302 4 Continuous-Time Signal Analysis: The Fourier Transform 


Again, we may want to synthesize a periodic signal by adding the first n harmonics 
and truncating all the higher harmonics. These examples show that data truncation 
can occur in both time and frequency domain. On the surface, truncation appears 
to be a simple problem of cutting off the data at a point where it is deemed to be 
sufficiently small. Unfortunately, this is not the case. Simple truncation can cause 
some unsuspected problems. 


Window Functions 

Truncation operation may be regarded as multiplying a signal of a large width 
by a window function of a smaller (finite) width. Simple truncation amounts to 
using a rectangular window wp(t) (Fig. 4.48a) in which we assign unit weight 
to all the data within the window width (|t| < D), and assign zero weight to all 
the data lying outside the window (|t| > T). It is also possible to use a window in 
which the weight assigned to the data within the window may not be constant. In 
a triangular window wp(t), for example, the weight assigned to data decreases 
linearly over the window width (Fig. 4.48b). 

Consider a signal f(t) and a window function w(t). If f(t) => F(w) and 
w(t) <=> W (w), and if the windowed function fy(t) ==> Fy(w), then 


fult) = f(t)w(t) and 


According to the width property of convolution, it follows that the width of Fy(w) 
equals the sum of the widths of F(w) and W(w). Thus, truncation of a signal 
increases its bandwidth by the amount of bandwidth of w(t). Clearly, the truncation 
of a signal causes its spectrum to spread (or smear) by the amount of the bandwidth 
of w(t). Recall that the signal bandwidth is inversely proportional to the signal 
duration (width). Hence, the wider the window, the smaller is its bandwidth, and 
the smaller is the spectral spreading. This result is predictable because a wider 
window means we are accepting more data (closer approximation), which should 
cause smaller distortion (smaller spectral spreading). Smaller window width (poorer 
approximation) causes more spectral spreading (more distortion). There are also 
other effects produced by the fact that W (w) is really not strictly bandlimited, and 
its spectrum — 0 only asymptotically. This causes the spectrum of F,,(w) — 0 
asymptotically also at the same rate as that of W(w), even though the F(w) may 
be strictly bandlimited. Thus, windowing causes the spectrum of F(w) to leak in 
the band where it is supposed to be zero. This effect is called leakage. These twin 
effects, the spectral spreading and the leakage, will now be clarified by an example. 

For an example, let us take f(t) = cos wot and a rectangular window w p(t) = 
rect(%), illustrated in Fig. 4.46b. The reason for selecting a sinusoid for f (t) is 
that its spectrum consists of spectral lines of zero width (Fig. 4.46a). This choice 
will make the effect of spectral spreading and leakage clearly visible. The spectrum 
of the truncated signal fw(t) is the convolution of the two impulses of F(w) with 
the sinc spectrum of the window function. Because the convolution of any function 
with an impulse is the function itself (shifted at the location of the impulse), the 
resulting spectrum of the truncated signal is (1/2 times) the two sinc pulses at 
two, as depicted in Fig. 4.46c. Comparison of spectra F(w) and F,,(w) reveals the 
effects of truncation. These are: 


Fy(w) = Fle) *W (w) 


1 The spectral lines of F(w) have zero width. But the truncated signal is spread 
out by 4r /T about each spectral line. The amount of spread is equal to the 
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Fig. 4.46 Windowing and its effects. 
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width of the mainlobe of the window spectrum. One effect of this spectral 
spreading (or smearing) is that if f(t) has two spectral components of frequen- 
cies differing by less than 47/T rad/s (2/T Hz), they will be indistinguishable 
in the truncated signal. The result is loss of spectral resolution. We would like 
the spectral spreading (mainlobe width) to be as small as possible. 


In addition to the mainlobe spreading, the truncated signal also has sidelobes, 
which decay slowly with frequency. The spectrum of f (t) is zero everywhere 
except at two. On the other hand, the truncated signal spectrum Fy (w) is zero 
nowhere because of sidelobes. These sidelobes decay asymptotically as 1/w. 
Thus, the truncation causes spectral leakage in the band where the spectrum 
of the signal f(t) is zero. The peak sidelobe magnitude is 0.217 times the 
mainlobe magnitude (13.3 dB below the peak mainlobe magnitude). Also, the 
sidelobes decay at a rate 1/w, which is —6 dB/octave (or —20 dB/ decade). This 
is the rolloff rate of sidelobes. We want smaller sidelobes with a faster rate 
of decay (high rolloff rate). Figure 4.46d shows |W g(w)| (in dB) as a function 
of w. This plot clearly shows the mainlobe and sidelobe features, with the first 
sidelobe amplitude —13.3 dB below the mainlobe amplitude, and the sidelobes 
decaying at a rate of —6 dB/octave (or —20 dB per decade). 
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So far, we have discussed the effect of signal truncation (truncation in time 
domain) on the signal spectrum. Because of time-frequency duality, the effect of 
spectral truncation (truncation in frequency domain) on the signal shape is similar. 


Remedies for Side Effects of Truncation 

For better results, we must try to minimize the truncation’s twin side effects, 
the spectral spreading (mainlobe width) and leakage (sidelobe). Let us consider 
each of these ills. 


1 The spectral spread (mainlobe width) of the truncated signal is equal to the 
bandwidth of the window function w(t). We know that the signal bandwidth 
is inversely proportional to the signal width (duration). Hence, to reduce the 
spectral spread (mainlobe width), we need to increase the window width. 


2 To improve the leakage behavior, we must search for the cause of the slow decay 
of sidelobes. In Chapter 3, we saw that the Fourier spectrum decays as 1/w for 
a signal with jump discontinuity, and decays as 1/w? for a continuous signal 
whose first derivative is discontinuous, and so on.t Smoothness of a signal is 
measured by the number of continuous derivatives it possesses. The smoother 
the signal, the faster the decay of its spectrum. Thus, we can achieve a given 
leakage behavior by selecting a suitably smooth window. 


3 For a given window width, the remedies for the two effects are incompatible. 
If we try to improve one, the other deteriorates. For instance, among all the 
windows of a given width, the rectangular window has the smallest spectral 
spread (mainlobe width), but has high level sidelobes, which decay slowly. A 
tapered (smooth) window of the same width has smaller and faster decaying 
sidelobes, but it has a wider mainlobe.t But we can compensate for the in- 
creased mainlobe width by widening the window. Thus, we can remedy both 
the side effects of truncation by selecting a suitably smooth window of sufficient 
width. 

There are several well-known tapered-window functions, such as Bartlett (tri- 
angular), Hanning (von Hann), Hamming, Blackman, and Kaiser, which truncate 
the data gradually. These windows offer different tradeoffs with respect to spectral 
spread (mainlobe width), the peak sidelobe magnitude, and the leakage rolloff rate 
as indicated in Table 4.3.89 Observe that all windows are symmetrical about the 
origin (even functions of t). Because of this feature, W (w) is a real function of w; 
that is, ZW (w) is either 0 or 7. Hence, the phase function of the truncated signal 
has a minimal amount of distortion. 

Figure 4.47 shows two well-known tapered-window functions, the von Hann 
(or Hanning) window wyan(z) and the Hamming window wuyam(z). We have 
intentionally used the independent variable z because windowing can be performed 
in time domain as well as in frequency domain; so z could be ¢ or w, depending on 
the application. 


}This result was demonstrated for periodic signals. However, it applies to aperiodic signals also. 
This is because we showed in Chapter 4 that if fr, (t) is a periodic signal formed by periodic 
extension of an aperiodic signal f(t), then the spectrum of fz, (t) is (1/Tp times) the samples of 
F(w). Thus, what is true of the decay rate of the spectrum of f7,(t) is also true of the rate of 
decay of F(w). 

+A tapered window yields a higher mainlobe width because the effective width of a tapered window 
is smaller than that of the rectangular window (see Sec. 2.7-2 [Eq. (2.67)] for the definition of 
effective width). Therefore, from the reciprocity of the signal width and its bandwidth, it follows 
that the rectangular window mainlobe width is smaller than that of a tapered window. 
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Fig. 4.47 Hanning and Hamming windows. 


There are hundreds of windows, each with differing characteristics. But the 
choice depends on a particular application. The rectangular window has the nar- 
rowest mainlobe. The Bartlett (triangle) window (also called the Fejer or Cesaro) 
is inferior in all respects to the Hanning window. For this reason it is rarely used 
in practice. Hanning is preferred over Hamming in spectral analysis because it has 
faster sidelobe decay. For filtering applications, on the other hand, the Hamming 
window is the choice because it has the smallest sidelobe magnitude for a given 
mainlobe width. The Hamming window is the most widely used, general purpose 
window. The Kaiser window, which uses Io(a), the Bessel function of the order 0, 
is more versatile and adjustable. Selecting a proper value of a (0 <a < 10) allows 
the designer to tailor the window to suit a particular application. The parameter 
a controls the mainlobe and sidelobe trade-off. When a = 0, the Kaiser window 
is the rectangular window. For a = 5.4414, it is the Hamming window, and when 


a = 8.885, it is the Blackman window. As a increases, the mainlobe width increases 
and the sidelobe level decreases. 


Table 4.3 


Some Window Functions and Their Characteristics 
R T EEE E E EE EES, 
e a eee 


Rolloff Peak 
Mainlobe Rate Sidelobe 


Window w(t) Width dB/oct Level in dB 


aaaea 


1 Rectangular: rect( 4) F —6 —13.3 
2 Bartlett: A(z) ks -12  —26.5 
3 Hanning: 0.5 [2 + cos (2z#)] SE -18 —31.5 
4 Hamming: 0.54 + 0.46 cos (222) sz -6 —42.7 
5 Blackman: 0.42 + 0.5 cos (27t) + 0.08 cos ( 48t) la -18 = —58.1 
6 Kaiser: TE 1<a<10 je 6 —59.9 (œ = 8.168) 
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4.9-1 Filter Design Using Windows 


We shall design an ideal lowpass filter of bandwidth W rad/s. For this filter, 
the impulse response h(t) = “sinc(Wt) (Fig. 4.48c) is noncausal and, therefore, 
unrealizable. Truncation of A(t) by a suitable window (Fig. 4.48a) makes it real- 
izable, although the resulting filter is now an approximation to the desired ideal 
filter.t We shall use a rectangular window wp(t) and a triangular (Bartlett) win- 
dow w(t) to truncate h(t), and then examine the resulting filters. The truncated 


impulse responses hr(t) and h(t) for the two cases are depicted in Fig. (4.48d). 


Ar(t) = h(t)wr(t) and hr(t) = h(t)wr(t) 


Hence, the windowed filter transfer function is the convolution of H (w) with the 
Fourier transform of the window, as illustrated in Fig. 4.48e and f. We make the 
following observations. 


1. The windowed filter spectra show spectral spreading at the edges, and in- 
stead of a sudden switch there is a gradual transition from the passband to 
the stopband of the filter. The transition band is smaller (27 /T rad/s) for the 
rectangular case compared to the triangular case (41/T rad/s). 

2. Although H (w) is bandlimited, the windowed filters are not. But the stopband 
behavior of the triangular case is superior to that of the rectangular case. 
For the rectangular window, the leakage in the stopband decreases slowly (as 
1/w) compared to that of the triangular window (as 1/w?). Moreover, the 
rectangular case has a higher peak sidelobe amplitude compared to that of the 
triangular window. 


4.10 Summary 


In Chapter 3 we represented periodic signals as a sum of (everlasting) sinusoids 
or exponentials (Fourier series). In this chapter we extended this result to aperiodic 
signals, which are represented by the Fourier integral (instead of the Fourier series). 
An aperiodic signal f(t) may be regarded as a periodic signal with period To > 
oo, so that the Fourier integral is basically a Fourier series with a fundamental 
frequency approaching zero. Therefore, for aperiodic signals, the Fourier spectra 
are continuous. This continuity means that a signal is represented as a sum of 
sinusoids (or exponentials) of all frequencies over a continuous frequency interval. 
The Fourier transform F(w), therefore, is the spectral density (per unit bandwidth 
in Hz). 

An ever-present aspect of the Fourier transform is the duality between time 
and frequency, which also implies duality between the signal f(t) and its transform 
F(w). This duality arises because of near-symmetrical equations for direct and 
inverse Fourier transforms. The duality principle has far-reaching consequences 
and yields many valuable insights into signal analysis. 

The scaling property of the Fourier transform leads to the conclusion that the 
signal bandwidth is inversely proportional to signal duration (signal width). Time 


tIn addition to truncation, we also need to delay the truncated function by F in order to render 
it causal. However, the time delay only adds a linear phase to the spectrum without changing the 
amplitude spectrum. For this reason, we shall ignore the delay in order to simplify our discussion. 
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shifting of a signal does not change its amplitude spectrum, but adds a linear phase 
spectrum. Multiplication of a signal by an exponential e/ot results in shifting the 
spectrum to the right by wo. In practice, spectral shifting is achieved by multi- 
plying a signal with a sinusoid such as cos wot (rather than the exponential elwot), 
This process is known as amplitude modulation. Multiplication of two signals re- 
sults in convolution of their spectra, whereas convolution of two signals results in 
multiplication of their spectra. 

For an LTIC system with the transfer function H(w), the input and output 
spectra F(w) and Y(w) are related by the equation Y(w) = F(w)H (w). This is 
valid only for asymptotically stable systems. For distortionless transmission of 
a signal through an LTIC system, the amplitude response |H(w)| of the system 
must be constant, and the phase response /H(w) should be a linear function of w 
over a band of interest. Ideal filters, which allow distortionless transmission of a 
certain band of frequencies and suppress all the remaining frequencies, are physically 
unrealizable (noncausal). In fact, it is impossible to build a physical system with 
zero gain [H (w) = 0] over a finite band of frequencies. Such systems (which include 
ideal filters) can be realized only with infinite time delay in the response. 

The energy of a signal f(t) is equal to 1/2m times the area under |F(w) 
(Parseval’s theorem). The energy contributed by spectral components within a 
band AF (in Hz) is given by |F(w)|?AF. Therefore, |F (w)|? is the energy spectral 
density per unit bandwidth (in Hz). The energy spectral density |F(w)| of a signal 
f(t) is the Fourier transform of the autocorrelation function f(t) of the signal f(t). 
Thus, a signal autocorrelation function has a direct link to its spectral information. 

The process of modulation shifts the signal spectrum to different frequencies. 
Modulation is used for many reasons: to transmit several messages simultaneously 
over the same channel to utilize channel’s high bandwidth, to effectively radiate 
power over a radio link, to shift signal spectrum at higher frequencies to overcome 
the difficulties associated with signal processing at lower frequencies, to effect the 
exchange of transmission bandwidth and transmission power required to transmit 
data at a certain rate. Broadly speaking there are two types of modulation; am- 
plitude and angle modulation. Each of these two classes has several subclasses. 
Amplitude modulation bandwidth is generally fixed. The bandwidth in angle mod- 
ulation, however, is controllable. The higher the bandwidth, the more immune is 
the scheme to noise. 

In practice, we often need to truncate data. Truncating data is like viewing it 
through a window, which permits a view of only certain portions of the data and 
hides (suppresses) the remainder. Abrupt truncation of data amounts to a rectan- 
gular window, which assigns a unit weight to data seen from the window and assigns 
zero weight to the remaining data. Tapered windows, on the other hand, reduce 
the weight gradually from 1 to 0. Data truncation can cause some unsuspected 
problems. For example, in computation of the Fourier transform, windowing (data 
truncation) causes spectral spreading (spectral smearing) that is characteristic of 
the window function used. A rectangular window results in the least spreading, but 
it does so at the cost of a high and oscillatory spectral leakage outside the signal 
band which decays slowly as 1/w. Compared to a rectangular window, tapered win- 
dows in general have larger spectral spreading (smearing), but the spectral leakage 
is smaller and decays faster with frequency. If we try to reduce spectral leakage 
by using a smoother window, the spectral spreading increases. Fortunately, the 
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spectral spreading can be reduced by increasing the window width. Therefore, we 
can achieve a given combination of spectral spread (transition bandwidth) and leak- 


age characteristics by choosing a suitable tapered window function of a sufficiently 
longer width T. 
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Problems 


4.1-1 Show that if f(t) is an even function of t, then 


oQ 
F(w) =2 f f(t) cos wt dt 
0 
and if f(t) is an odd function of t, then 
oO 
F(w) = 25 | f(t) sin wt dt 

0 

Hence, prove that if f(t) is a real and even function of t, then F(w) is a real and even 


function of w. In addition, if f(t) is a real and odd function of t, then F(w) is an 
imaginary and odd function of w. 


4.1-2 Show that for a real f(t), Eq. (4.8b) can be expressed as 


f(t) = f |F (w)| cos [wt + LF (w)] dw 
0 


This is the trigonometric form of the Fourier integral. Compare this with the compact 
trigonometric Fourier series. 


4.1-3 A signal f(t) can be expressed as the sum of even and odd components (see Sec. 


1.5-2): 
F(t) = felt) + folt) 
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Fig. P4.1-4 


4.1-4 
4.1-5 


4.1-6 
4.1-7 
4.2-1 


4.2-2 


Fig. P4.1-5 
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2 


Fig. P4.1-6 


Fig. P4.1-7 


(a) If f(t) == F(w), show that for real f(t), 


felt) <= > Re[F(w)] and folt) <> j Im[F(v)] 


(b) Verify these results by finding the Fourier transforms of the even and odd com- 
ponents of the following signals: (i) u(t) (ii) e~*tu(t). 
From definition (4.8a), find the Fourier transforms of the signals f(t) in Fig. P4.1-4. 


From definition (4.8a), find the Fourier transforms of the signals depicted in Fig. 
P4.1-5. 


Using Eq. (4.8b), find the inverse Fourier transforms of the spectra in Fig. P4.1-6 
Using Eq. (4.8b), find the inverse Fourier transforms of the spectra in Fig. P4.1-7. 
Sketch the following functions: 

(a) rect (§) (b) A( 28) (c) rect (4%) (d) sine (%) (e) sinc (#3) 

(£) sinc (£)rect (7f-). Hint: f(=>%) is f(2) right-shifted by a. 

From definition (4.8a), show that the Fourier transform of rect (t — 5) is 

sinc (Z)eF. Sketch the resulting amplitude and phase spectra. 
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4,2-3 


4.2-4 


4.3-1 


4.3-2 


4.3-3 


Fig. P4.2-4 
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Fig. P4.3-2 


From definition (4.8b), show that the inverse Fourier transform of rect ( 2-10) is 
sinc (mt) e710, 
Find the inverse Fourier transform of F(w) for the spectra illustrated in Figs. P4.2-4a 
and b. 
Hint: F(w) = |F(w)|e? LF) This problem illustrates how different phase spectra 
(both with the same amplitude spectrum) represent entirely different signals. 
Apply the symmetry property to the appropriate pair in Table 4.1 to show that 
(a) 3[6(t) + 4] = uw) (b) 6(t + T) + 6(t—T) => 2cos Tw 
(c)6(t +T) — 6(¢ — T) <=> 2sin Tw. 
The Fourier transform of the triangular pulse f(t) in Fig. P4.3-2a is expressed as 
1 jw . jw 
F(w)= pale — jwe™ — 1) 


Using this information, and the time-shifting and time-scaling properties, find the 
Fourier transforms of the signals f:(t) (i = 1, 2, 3, 4, 5) shown in Fig. P4.3-2. 

Hint: See Sec. 1.3 for explanation of various signal operations. Pulses f;(t) (i = 2, 3, 4 
can be expressed as a combination of f(t) and fı(t) with suitable time shift (which 
may be positive or negative). 

Using only the time-shifting property and Table 4.1, find the Fourier transforms of 
the signals depicted in Fig. P4.3-3. 
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Fig. P4.3-5 


Hint: Signals in Figs. b, c, and d can be expressed in the form f(t)[u(t) — u(t - a)). 
Using the time-shifting property, show that if f(t) +> F(w), then 

ft+T) + flt- T) 4 2F(w) cos Tw 
This is the dual of Eq. (4.41). Using this result and pairs 17 and 19 in Table 4.1, find 
the Fourier transforms of the signals shown in Fig. P4.3-4. 


Prove the following results, which are duals of each other: 


f(t) sin wot <=> zl Fw — wo) — F(w + wo)] 
glt +T) — f(t- T)| <> F(w)sin Tw 


Using the latter result and Table 4.1, find the Fourier transform of the signal in Fig. 
P4.3-5. 

The signals in Fig. P4.3-6 are modulated signals with carrier cos 10t. Find the Fourier 
transforms of these signals using the appropriate properties of the Fourier transform 
and Table 4.1. Sketch the amplitude and phase spectra for parts (a) and (b). 


Using the frequency-shifting property and Table 4.1, find the inverse Fourier transform 
of the spectra depicted in Fig. P4.3-7. 


Using the time convolution property, prove pairs 2, 4, 13 and 14 in Table 2.1 (assume 
A < 0 in pair 2, Ai and Az < 0 in pair 4, À; < 0 and Ag > 0 in pair 13, and Ai and 
àz > 0 in pair 14). Hint: You will need partial fraction expansion. For pair 2, you 
need to apply the result in Eq. (1.23). 
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(a) (b) 


(c) 


Fig. P4.3-6 


4 4 
Fig. P4.3-7 


4.3-9 A signal f(t) is bandlimited to B Hz. Show that the signal f(t) is bandlimited to 
nB Hz. Hint: Start with n = 2. Use frequency convolution property and the width 
property of convolution. 


4.3-10 Find the Fourier transform of the signal in Fig. P4.3-3a by three different methods: 
(a) By direct integration using the definition (4.8a). 
(b) Using only pair 17 Table 4.1 and the time-shifting property. 


(c) Using the time-differentiation and time-shifting properties, along with the fact 
that 6(t) 4> 1. 


Hint: 1 — cos 2x = 2sin? z. 


4.3-11 (a) Prove the frequency differentiation property (dual of the time differentiation): 
-jtf(t) = Fw) 
dw 


apis this property and pair 1 (Table 4.1), determine the Fourier transform of 
te~“u(t). 
4.4-1 For an LTIC system with transfer function 

1 


Ne) Saeed 


find the (zero-state) response if the input f(t) is (a) e~?*u(t) (b) e7*u(t) 
(c) e'u(—t) (d) u(t) 
Hint: For part (d), you need to apply the result in Eq. (1.23). 


4.4-2 A stable LTIC system is specified by the transfer function 


-1 
jw —2 


H(w) = 
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y(t=y, Cy, (1) 


Find the impulse response of this system and show that this is a noncausal system. 
Find the (zero-state) response of this system if the input f (t) is 
(a) e~*u(t) (b)eu(—t). 


Signals fı(t) = 10*rect (104t) and fo(t) = 6(t) are applied at the inputs of the ideal 
lowpass filters Hi(w) = rect ( 30400x ) and H2(w) = rect (350007 ) (Fig. P4.4-3). The 
outputs yi(t) and y2(t) of these filters are multiplied to obtain the signal y(t) = 
yr(t)ya(t). 

(a) Sketch Fi(w) and Fa(w). 

(b) Sketch Hi(w) and H2(w). 

(c) Sketch Yi(w) and Y2(w). 

(d) Find the bandwidths of y:(t), y2(t), and y(t). 

Hint for part (d): Use the convolution property and the width property of convolution 
to determine the bandwidth of y:(t)ya(t). 


A lowpass system time constant is often defined as the width of its unit impulse 
response h(t) (see Sec. 2.7-2). An input pulse p(t) to this system acts like an impulse 
of strength equal to the area of p(t) if the width of p(t) is much smaller than the system 
time constant. Assume p(t) to be a lowpass pulse, that is its spectrum is concentrated 
at low frequencies. Verify this behavior by considering a system whose unit impulse 
response is h(t) = rect (zo). The input pulse is a triangle pulse p(t) = A(;p4s). 
The area under this pulse is A = 0.5 x 1078. Show that the system response to this 
pulse is very nearly the system response to the input A6(t). 


A lowpass system time constant is often defined as the width of its unit impulse 
response h(t) (see Sec. 2.7-2). An input pulse p(t) to this system passes practically 
without distortion, if the width of p(t) is much greater than the system time constant. 
Assume p(t) to be a lowpass pulse, that is its spectrum is concentrated at low fre- 
quencies. Verify this behavior by considering a system whose unit impulse response 
is h(t) = rect (qr): The input pulse is a triangle pulse p(t) = A(t). Show that the 
system output to this pulse is very nearly kp(t), where k is the system gain to a dc 
signal, that is, k = H(0). 


A causal signal h(t) has a Fourier transform H(w). If R(w) and X(w) are the real 
and the imaginary parts of H(w), that is , H(w) = R(w)+jX (w), then show that 


roi f Ze and x(u=-2 f 2O 


T Jie “TY T J oY 


assuming that h(t) has no impulse at the origin. This pair of integrals defines the 
Hilbert transform. 

Hint: Let he(t) and ho(t) be the even and odd components of h(t). Use results in 
Prob. 4.1-3. See Fig. 1.24 for the relationship between he(t) and ho(t). Recall that 
sgn(t) <=> 2/jw. Use convolution property. 

This problem states one of the important properties of causal systems: that the real 
and imaginary parts of the transfer function of a causal system are related. If one 
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4.5-1 


4.5-2 


4.5-3 


4.6-1 


4.6-2 


4.6-3 


specifies the real part, the imaginary part cannot be specified independently. Fhe 
imaginary part is predetermined by the real part, and vice versa. This result also 
leads to the conclusion that the magnitude and angle of H (w) are related provided 
all the poles and zeros of H (w) lie in the LHP. 


Consider a filter with the transfer function 


H(w) = en (kw? +jwto) 


Show that this filter is physically unrealizable by using the time-domain criterion 
[noncausal A(t)] and the frequency-domain (Paley-Wiener) criterion. Can this filter 
be made approximately realizable by choosing a sufficiently large to? Use your own 
(reasonable) criterion of approximate realizability to determine to. 

Hint: Use pair 22 in Table 4.1. 


Show that a filter with transfer function 


2(10°) -juto 


ch w2 + 1020 


is unrealizable. Can this filter be made approximately realizable by choosing a suffi- 


ciently large to? Use your own (reasonable) criterion of approximate realizability to 
determine to. 


Hint: Show that the impulse response is noncausal. 


Determine if the filters with the following transfer functions are physically realizable. 


If they are not realizable, can they be realized exactly or approximately by allowing 
a finite time delay in the response? 


H(w) = (a) 107° sinc (107%w) (b) ota (aia) (c) 2r 6(w) 


Show that the energy of a Gaussian pulse 


2 
FO = dpe e807 


is rci Verify this result by deriving the energy Eş from F(w) using Parseval’s 
theorem. 


Hint: See pair 22 in Table 4.1. Use the fact that 
f e771? de = Vin 
oo 


Show that 
f sinc? (kz) dz = k 


—oo 


Hint: Recognize that the integral is the energy of f(t) = sinc (kt). Find this energy 
by using Parseval’s theorem. 


A lowpass signal f(t) is applied to a squaring device. The squarer output f?(t) is 
applied to a lowpass filter of bandwidth AF Hz (Fig. P4.6-3). Show that if AF is 
very small (AF — 0), then the filter output is a de signal y(t) ~ 2EsAF. 
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£.6-4 


4.6-5 


4.7-1 


4.7-2 
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PO Lowpass y(t) = 2EAf 
Filter 


Fig. P4.6-3 


JO 
32 


Hint: If f° (t) — A(w), then show that Y (w) ~ [4r A(0)AF]ó(w) if AF > 0. Now, 
show that A(0) = Ey. 
Generalize Parseval’s theorem to show that for real, Fourier transformable signals 


fi(t) and fo(t) 


is fi (t) fo(t) dt = n T Fi (-w) Fo(w) dw = x | F,(w)F2(—w) dw 


For the signal 
2a 
f) = 


Ha? 

determine the essential bandwidth B Hz of f(t) such that the energy contained in 
the spectral components of f(t) of frequencies below B Hz is 99% of the signal energy 
Eş. Hint: See Exercise E4.5b. 


For each of the following 3 baseband signals (i) m(t) = cos 1000¢ (ii) m(t) = 
2cos 1000¢ + cos 2000t (iii) m(t} = cos 1000ż cos 3000t 

(a) Sketch the spectrum of m(t). 

(b) Sketch the spectrum of the DSB-SC signal m(t) cos 10,000t. 

(c) Identify the upper sideband (USB) and the lower sideband (LSB) spectra. 

(d) Identify the frequencies in the baseband, and the corresponding frequencies in 
the DSB-SC, USB and LSB spectra. Explain the nature of frequency shifting in each 


case. 


km(f)cos@,t 


(b) 


cos? œ, t 
(Carrier) 


Fig. P4.7-2 


You are asked to design a DSB-SC modulator to generate a modulated signal 
km(t) cos wet, where m(t) is a signal bandlimited to B Hz (Fig. P4.7-2a). Figure 
P4,7-2b shows a DSB-SC modulator available in the stock room. The bandpass filter 
is tuned to we. The carrier generator available generates not cos wet, but cos? wet. 
(a)Explain whether you would be able to generate the desired signal using only this 
equipment. If so, what is the value of k? 

(b) Determine the signal spectra at points b and c, and indicate the frequency bands 
occupied by these spectra. 

(c) What is the minimum usable value of we? 

(d) Would this scheme work if the carrier generator output were cos? wet? Explain. 
(e) Would this scheme work if the carrier generator output were cos” wet for any 
integer n > 2? 
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4.7-3 


4.7-4 


4.7-5 


km(t) cos ©, t 


(a) 


x(t) 


(b) 


Fig. P4.7-3 


In practice, the analog multiplication operation is difficult and expensive. For this rea- 
son, in amplitude modulators, it is necessary to find some alternative to multiplication 
of m(t) with cos wet. Fortunately, for this purpose, we can replace multiplication with 
switching operation. A similar observation applies to demodulators. In the scheme 
depicted in Fig. P4.7-3a, the period of the rectangular periodic pulse z(t) shown in 
Fig. P4.7-3b is To = 2r /we. The bandpass filter is centered at +we. Note that mul- 
tiplication by a square periodic pulse x(t) in Fig. P4.7-3b amounts to periodic on-off 
switching of m(t). This is a relatively simple and inexpensive operation. 

Show that this scheme can generate amplitude modulated signal k cos wet. Determine 
the value of k. Show that the same scheme can also be used for demodulation provided 
the bandpass filter in Fig. P4.7-3a is replaced by a lowpass (or baseband) filter. 


[A+m ()]cos @,¢ 


Fig. P4.7-5 


Figure P4.7-4 presents a scheme for coherent (synchronous) demodulation. Show that 


oy scheme can demodulate the AM signal [A + m(t)] cos wet regardless of the value 
of A. 


Sketch the AM signal [A+m(t)] cos wet for the periodic triangle signal m(t) illustrated 
in Fig. P4.7-5 corresponding to the modulation index: (a) u = 0.5, (b) p = 1, (c) 
H = 2, and (d) x = œ. How do you interpret the case u = 00? 
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4.7-6 For each of the following three baseband signals (a) m(t) = cos 100¢ (b) m(t) = 
cos 100¢ + 2cos 300¢ (c) m(t) = cos 100t cos 500¢ 
(i) Sketch the spectrum of m(t). 
(ii) Find and sketch the spectrum of the DSB-SC signal 2m/(t) cos 1000¢. 
(iii) From the spectrum obtained in (ii), suppress the LSB spectrum to obtain the 
USB spectrum. 
(iv) Knowing the USB spectrum in (ii), write the expression 91,5, (t) for the USB 
signal. 
(v) Repeat (iii) and (iv) to obtain the LSB signal »,,, (t). 


Sampling | 


eave a-vicaie-a! 


1 i j ‘ | 


A continuous-time signal can be processed by processing its samples through 
a discrete-time system. For this purpose, it is important to maintain the signal 
sampling rate sufficiently high so that the original signal can be reconstructed from 
these samples without error (or with an error within a given tolerance). The neces- 
sary quantitative framework for this purpose is provided by the sampling theorem 
derived in the following section. 


4.8-1 Sketch Yrm (t) and ppu (t) for the modulating signal m(t) depicted in Fig. P4.8-1, 
given we = 2r x 107, ky = 2m x 10°, and kp = 50r. 


5.1 The Sampling Theorem 


We now show that a real signal whose spectrum is bandlimited to B Hz 


=>. [F(w) =0 for |w| > 27B] can be reconstructed exactly (without any error) from its 
M yal samples taken uniformly at a rate Fs > 2B samples per second. In other words, 
— 10° the minimum sampling frequency is F, = 2B Hz.{ 
Fig. P4.8-2 


To prove the sampling theorem, consider a signal f(t) (Fig. 5.1a) whose spec- 
trum is bandlimited to B Hz (Fig. 5.1b).{ For convenience, spectra are shown as 
functions of w as well as of F (Hz). Sampling f(t) at a rate of Fs Hz (Fs samples 
per second) can be accomplished by multiplying f(t) by an impulse train 67(t)(Fig. 
5.1c), consisting of unit impulses repeating periodically every T seconds, where 
T = 1/F,. The result is the sampled signal f(t) resented in Fig. 5.1d. The sampled 
signal consists of impulses spaced every T seconds (the sampling interval). The nth 
impulse, located at t = nT, has a strength f(nT), the value of f(t) att = nT. 


4.8-2 A baseband signal m(t} is a periodic saw tooth signal shown in Fig. P4.8-2. Sketch 
veu(t) and y,,,(t) for this m(t) if we = 2r x 10°, ky = 20,0007, and kp = 1/2. 
Explain why it is necessary to use kp < v in this case. 


4.8-3 For a modulating signal 


m(t) = 2 cos 100¢ + 18 cos 2000zt 


Determine the bandwidths of the corresponding Ypy (t) and Yp,,(t) if kf = 10007 


pene F(t) = F()Er(t) = D> f (nT )6(t — nT) (5.1) 


4.8-4 An angle-modulated signal is described by the equation 


{The theorem stated here (and proved subsequently) applies to lowpass signals. A bandpass signal 
whose spectrum exists over a frequency band Fe — B < |F| < Fe+ 2 has a bandwidth of B Hz. 
Such a signal is uniquely determined by 2B samples per second. In general, the sampling scheme 
is a bit more complex in this case. It uses two interlaced sampling trains, each at a rate of B 
samples per second (known as second-order sampling). See, for example, the references. 1? 


{The spectrum F(w) in Fig. 5.1b is shown as real, for convenience. However, our arguments are 
valid for complex F(w) as well. 


Pum (t) = 10 cos (wet + 0.1 sin 20007t) 


(a) Find the frequency deviation AF (b) Estimate the bandwidth of yrm(t). 
4.8-5 Repeat Prob. 4.8-4 if 


yem(t) = 5cos (wet + 20sin 10007t + 10sin 20007t) 
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(a) (b) 
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FO Fio) 
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(d) 
Fig. 5.1 Sampled signal and its Fourier spectrum. 


Because the impulse train ôr (t) is a periodic signal of period T, it can be expressed 
as a trigonometric Fourier series already obtained in Example 3.8 [Eq. (3.81)] 


Qn 
r(t) = rll + 2cos wet + 2cos Qwest + 2cos 3wat ++} Ws = a = QnF, (5.2) 


Therefore 


F(t) = f(t)6r(t) = FUO + 2f (t) cos wst + 2f (t) cos 2wst + 2f (t) cos 3wst +>] (5.3) 


To find F(w), the Fourier transform of f(t), we take the Fourier transform of the 
right-hand side of Eq. (5.3), term by term. The transform of the first term in the 
brackets is F(w). The transform of the second term 2f (t) cos wet is F(w — ws) + 
F(w +we) [see Eq. (4.41)}. This represents spectrum F(w) shifted to ws and —ws. 
Similarly, the transform of the third term 2f (t) cos 2wst is F(w-—2ws)+F (w+ 2ws), 
which represents the spectrum F (w) shifted to 2ws and —2ws, and so on to infinity. 
This result means that the spectrum F(w) consists of F(w) repeating periodically 
with period ws = a rad/s, or Fs = + Hz, as depicted in Fig. 5.le. There is also a 
constant multiplier 1/T in Eq. (5.3). Therefore 


F(w — nws) (5.4) 
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_ If we are to reconstruct f(t) from f(t), we should be able to recover F(w) from 
F(w). This recovery is possible if there is no overlap between successive cycles of 
F(w). Figure 5.le indicates that this requires 


F: > 2B (5.5) 
Also, the sampling interval T = 1/¥,. Therefore 
1 
Cis 
T< 25 (5.6) 


Thus, as long as the sampling frequency Fs is greater than twice the signal band- 
width B (in hertz), F(w) will consist of nonoverlapping repetitions of F (w). In 
such a case, Fig. 5.le indicates that f(t) can be recovered from its samples f(t) 
by passing the sampled signal f(t) through an ideal lowpass filter of bandwidth B 
Hz. The minimum sampling rate F, = 2B required to recover f(t) from its samples 
f(t) is called the Nyquist rate for f(t), and the corresponding sampling interval 
T = 1/2B is called the Nyquist interval for f(t).7 


E Example 5.1 

In this example, we examine the effects of sampling a signal at the Nyquist rate, below 
the Nyquist rate (undersampling) and above the Nyquist rate (oversampling). Consider 
a signal f(t) = sinc?(5rt) (Fig. 5.2a) whose spectrum is F(w) = 0.2 A(s6z) (Fig. 5.2b). 
The bandwidth of this signal is 5 Hz (107 rad/s). Consequently, the Nyquist rate is 10 
Hz; that is, we must sample the signal at a rate no less than 10 samples/s. The Nyquist 
interval is T = 1/2B = 0.1 second. 

Recall that the sampled signal spectrum consists of (1/T)F(w) = 92 A(z6z) repeat- 
ing periodically with a period equal to the sampling frequency F, Hz. We present this 
information in the following Table for three sampling rates: Fa = 5 Hz (undersampling), 
10 Hz (Nyquist rate), and 20 Hz (oversampling). 


sampling frequency Fs | sampling interval T 


5 Hz 0.2 
10 Hz 0.1 


In the first case (undersampling), the sampling rate is 5 Hz (5 samples/sec.), and the 
spectrum +F(w) repeats every 5 Hz (10m rad/sec.). The successive spectra overlap, as 
depicted in Fig. 5.2d, and the spectrum F(w) is not recoverable from F(w); that is, f(t) 
cannot be reconstructed from its samples F(t) in Fig. 5.2c. In the second case, we use the 
Nyquist sampling rate of 10 Hz (Fig. 5.2e). The spectrum F(w) consists of back-to-back, 
nonoverlapping repetitions of +F (w) repeating every 10 Hz. Hence, F'(w) can be recovered 
from F'(w) using an ideal lowpass filter of bandwidth 5 Hz (Fig. 5.2f). Finally, in the last 
case of oversampling (sampling rate 20 Hz), the spectrum F(w) consists of nonoverlapping 
repetitions of FF (w) (repeating every 20 Hz) with empty band between successive cycles 


}We have proved that for errorfree recovery of a signal of bandwidth B Hz, the sampling rate 
F > 2B. However, in a special case, where F(w) contains an impulse at the highest frequency 
B, the sampling rate must be Fs > 2B Hz. Such is the case when f(t) = sin 2xBt. This signal 
is bandlimited to B Hz, but all of its samples are zero when taken at a rate Fs = 2B (starting at 
t= 0), and f(t) cannot be recovered from its Nyquist samples. 
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Practical Filter 


N4 (h) 


1 
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Fig. 5.2 Effect of undersampling and oversampling. 
(Fig. 5.2h). Hence, F(w) can be recovered from F(w) using an ideal lowpass filter or even 
a practical lowpass filter (shown dotted in Fig. 5.2h).t E 


A Exercise E5.1 
Find the Nyquist rate and the Nyquist interval for the signals (a) sinc (1007t) and 


(b) sinc (100at)+ sinc (507t). 


+The filter should have a constant gain between 0 to 5 Hz, and zero gain beyond 10 Hz. In practice, 
the gain beyond 10 Hz can be made negligibly small, but not zero. 


zy) 5 3 20 F (Hz) > 
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f(t) 


l he) Sampled signal 
Pea 


Reconstructed signal 
yt) 


(a) 


-2nB Q 2nB 4nB o — 


Fig. 5.3 Simple interpolation using a zero-order hold circuit. 


Answer: The Nyquist interval is 0.01 second and the Nyquist sampling rate is 100 Hz for both the 
signals. y 


5.1-1 Signal Reconstruction: The Interpolation Formula 


The process of reconstructing a continuous-time signal f(t) from its samples is 
also known as interpolation. In Sec. 5.1, we saw that a signal f(t) bandlimited 
to B Hz can be reconstructed (interpolated) exactly from its samples. This recon- 
struction is accomplished by passing the sampled signal through an ideal lowpass 
filter of bandwidth B Hz. As seen from Eq. (5.3) [or Fig. 5.1le], the sampled signal 
contains a component + f(t) and to recover f(t) (or F(w)), the sampled signal must 
be passed through an ideal lowpass filter of bandwidth B Hz and gain T. Thus, the 
reconstruction (or interpolating) filter transfer function is 


w 
H (w) = T rect (5) (5.7) 
The interpolation process here is expressed in the frequency-domain as a filtering 
operation. Now, we shall examine this process from a different viewpoint, that of 
the time-domain. 

To begin with, let us consider a very simple interpolating filter whose impulse 
response is rect ( +), depicted in Fig. 5.3a. This is a gate pulse centered at the origin, 
having unit height, and width T (the sampling interval). We shall find the output 
of this filter when the input is the sampled signal f(t). Each sample in f(t), being 
an impulse, produces at the output a gate pulse of height equal to the strength of 
the sample. For instance, the kth sample is an impulse of strength f (kT) located at 
t—kT, and can be expressed as f(kT')6(t — kT). When this impulse passes through 
the filter, it produces at the output a gate pulse of height f (kT), centered att = kT 
(shown shaded in Fig. 5.3b). Each sample in f(t) will generate a corresponding gate 
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pulse resulting in the filter output that is a staircase approximation of f(t), shown 
dotted in Fig. 5.3b. This filter thus gives a crude form of interpolation. 

The transfer function of this filter H (w) is the Fourier transform of the impulse 
response rect (4). Assuming the Nyquist sampling rate; that is, T = 1/2B 


h(t) = rect (=) = rect (2Bt) 


and 


H(w) =T sinc (F) = 5 sinc (5) (5.8) 


The amplitude response |H (w)| for this filter, illustrated in Fig. 5.3c, explains the 
reason for the crudeness of this interpolation. This filter, also known as the zero- 
order hold filter, is a poor form of the ideal lowpass filter (shown shaded in Fig. 
5.3c) required for exact interpolation.t 

We can improve on the zero-order hold filter by using the first-order hold 
filter, which results in a linear interpolation instead of the staircase interpolation. 
The linear interpolator, whose impulse response is a triangle pulse Al) results 
in an interpolation in which successive sample tops are connected by straight line 
segments (see Prob. 5.1-5). 

The ideal interpolation filter transfer function obtained in Eq. (5.7) is illustrated 
in Fig. 5.4a. The impulse response of this filter, the inverse Fourier transform of 
H(w) is 

h(t) = 2BT sinc (27r Bt) (5.9a) 


Assuming the Nyquist sampling rate; that is, 2BT = 1, then 
h(t) = sinc (2r Bt) (5.9b) 


This h(t) is depicted in Fig. 5.4b. Observe the very interesting fact that h(t) = 0 
at all Nyquist sampling instants (t = +75) except at t = 0. When the sampled 
signal f(t) is applied at the input of this filter, the output is f(t). Each sample in 
f(t), being an impulse, generates a sinc pulse of height equal to the strength of the 
sample, as illustrated in Fig. 5.4c. The process is identical to that depicted in Fig. 
5.3b, except that h(t) is a sinc pulse instead of a gate pulse. Addition of the sinc 
pulses generated by all the samples results in f(t). The kth sample of the input f(t) 
is the impulse f (kT)6(t — kT); the filter output of this impulse is f(kT)h(t — kT). 
Hence, the filter output to f(t), which is f(t), can now be expressed as a sum 


f(t) = So f(kT)a(t - kT) 
k 
= Sof (kT) sinc [2nB(t — kT)| (5.10a) 
k 


= XOST) sinc (27 Bt — kr) (5.10b) 
k 


{Figure 5.3a shows that the impulse response of this filter is noncausal, and this filter is not 
realizable. In practice, we make it realizable by delaying the impulse response by T/2. This 
merely delays the output of the filter by T/2. 


5.1 The Sampling Theorem 325 
H(@) 
T 
-27B 2nB o — 
(a) 
Sampled signal 


Reconstructed signal 


ft) f(t) 


Fig. 5.4 Ideal interpolation. 


Equation (5.10) is the interpolation formula, which yields values of f(t) between 
samples as a weighted sum of all the sample values. 


| Example 5.2 
Find a signal f(t) that is bandlimited to B Hz, and whose samples are 


f(0)=1 and f(4T) = f(+2T) = f(43T) =--.=0 


where the sampling interval T is the Nyquist interval for f (t); that is, T = 1/2B. 

We use the interpolation formula (5.10b) to construct f (t) from its samples. Since 
all but one of the Nyquist samples are zero, only one term (corresponding to k = 0) in the 
summation on the right-hand side of Eq. (5.10b) survives. Thus 


f(t) = sinc (27 Bt) 


This signal is illustrated in Fig. 5.4b. Observe that this is the only signal that has a 


bandwidth B Hz and the sample values f(0) = 1 and f(nT) = 0 (n #0). No other signal 
satisfies these conditions. 


5.1-2 Practical Difficulties in Signal Reconstruction 


If a signal is sampled at the Nyquist rate F; = 2B Hz, the spectrum F(w) con- 
sists of repetitions of F(w) without any gap between successive cycles, as depicted 
in Fig. 5.5a. To recover f(t) from f(t), we need to pass the sampled signal f(t) 
through an ideal lowpass filter, shown dotted in Fig. 5.5a. As seen in Sec. 4.5, such 
a filter is unrealizable; it can be closely approximated only with infinite time delay 
in the response. In other words, we can recover the signal f (t) from its samples 
with infinite time delay. A practical solution to this problem is to sample the signal 
at a rate higher than the Nyquist rate (F, > 2B or w, > 4nB). The result is 
F(w), consisting of repetitions of F(w) with a finite band gap between successive 
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(a) 


(b) 


Fig. 5.5 Spectra of a signal sampled at (a) the Nyquist rate (b) above the Nyquist rate. 


cycles, as illustrated in Fig. 5.5b. We can now recover F(w) from F(w) using a 
lowpass filter with a gradual cutoff characteristic, shown dotted in Fig. 5.5b. But 
even in this case, the filter gain must be zero beyond the first cycle of F(w) (see 
Fig. 5.5b). According to the Paley-Wiener criterion, it is impossible to realize even 
this filter. The only advantage in this case is that the required filter can be closely 
approximated with a smaller time delay. This fact indicates that it is impossible 
in practice to recover a bandlimited signal f(t) exactly from its samples, even if 
the sampling rate is higher than the Nyquist rate. However, as the sampling rate 
increases, the recovered signal approaches the desired signal more closely. 


Fo) 
Recovered spectrum 


Os Os 
Lost tail gets 2 Lost tail 
folded back 
4 S 
2 f 


Fig. 5.6 Aliasing effect. 


The Treachery of Aliasing 


There is another fundamental practical difficulty in reconstructing a signal from 
its samples. The sampling theorem was proved on the assumption that the signal 
f(t) is bandlimited. AH practical signals are timelimited; that is, they are of 
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finite duration or width. We can demonstrate (see Prob. 5.1-10) that a signal cannot 
be timelimited and bandlimited simultaneously. If a signal is timelimited, it cannot 
be bandlimited and vice versa (but it can be simultaneously nontimelimited and 
nonbandlimited). Clearly, all practical signals, which are necessarily timelimited, 
are nonbandlimited; they have infinite bandwidth, and the spectrum F(w) consists 
of overlapping cycles of F (w) repeating every Fs Hz (the sampling frequency), as 
illustrated in Fig. 5.6. Because of infinite bandwidth in this case, the spectral overlap 
is a constant feature, regardless of the sampling rate. Because of the overlapping 
tails, F(w) no longer has complete information about F(w), and it is no longer 
possible, even theoretically, to recover f(t) from the sampled signal f(t). If the 
sampled signal is passed through an ideal lowpass filter, the output is not F(w) but 
a version of F(w) distorted as a result of two separate causes: 


1. The loss of the tail of F(w) beyond |F| > F,/2 Hz; 


2. The reappearance of this tail inverted or folded onto the spectrum. Note that 
the spectra cross at frequency F,/2 = 1/2T Hz. This frequency is called the 
folding frequency. The spectrum, therefore, folds onto itself at the folding 
frequency. For instance, a component of frequency fa + Fz shows up as or 
“impersonates” a component of lower frequency Ta — F, in the reconstructed 
signal. Thus, the components of frequencies above Fs/2 reappear as com- 
ponents of frequencies below F,/2. This tail inversion, known as spectral 
folding or aliasing, is shown shaded in Fig. 5.6. In this process of aliasing, 
not only are we losing all the components of frequencies above F,/2 Hz, but 
these very components reappear (aliased) as lower frequency components. This 
reappearance destroys the integrity of the lower frequency components also, as 
depicted in Fig. 5.6. 


Aliasing problem is analogous to that of an army with a platoon that has secretly 
defected to the enemy side. The platoon is, however, ostensibly loyal to the army. 
The army is in double jeopardy. First, the army has lost this platoon as a fighting 
force. In addition, during actual fighting, the army will have to contend with the 
sabotage by the defectors, and will have to find another loyal platoon to neutralize 
the defectors. Thus, the army has lost two platoons in nonproductive activity. 


A Solution: The Antialiasing Filter 


If you were the commander of the betrayed army, the solution to the problem 
would be obvious. As soon as the commander gets wind of the defection, he would 
incapacitate, by whatever means, the defecting platoon before the fighting begins. 
This way he loses only one (the defecting) platoon. This is a partial solution to the 
double jeopardy of betrayal, a solution that partly rectifies the problem and reduces 
the losses to half. 

We follow exactly the same procedure. The potential defectors are all the fre- 
quency components beyond a = z Hz. We should eliminate (suppress) these 
components from f(t) before sampling f(t). This way we lose only the components 
beyond the folding frequency a Hz; these components now cannot reappear to cor- 
rupt the components with frequencies below the folding frequency. This suppression 
of higher frequencies can be accomplished by an ideal lowpass filter of bandwidth 
F,/2 Hz. This filter is called the antialiasing filter. Note that the antialiasing 
operation must be performed before the signal is sampled. 
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Fig. 5.7 Effect of practical sampling. 


The antialiasing filter, being an ideal filter, is unrealizable. In practice, we use 
a steep cutoff filter, which leaves a sharply attenuated residual spectrum beyond 
the folding frequency ¥,/2. 


Practical Sampling 

In proving the sampling theorem, we assumed ideal samples obtained by multi- 
plying a signal f(t) by an impulse train which is physically nonexistent. In practice, 
we multiply a signal f(t) by a train of pulses of finite width, depicted in Fig. 5.7b. 
The sampled signal is illustrated in Fig. 5.7c. We wonder whether it is possible to 
recover or reconstruct f(t) from the sampled signal f(t) in Fig. 5.7c. Surprisingly, 
the answer is affirmative, provided that the sampling rate is not below the Nyquist 
rate. The signal f(t) can be recovered by lowpass filtering f(t) as if it were sampled 
by impulse train. 

The plausibility of this result becomes apparent when we consider the fact that 
reconstruction of f(t) requires the knowledge of the Nyquist sample values. This 
information is available or built in the sampled signal f(t) in Fig. 5.7c because the 
kth sampled pulse strength is f(kT’). To prove the result analytically, we observe 
that the sampling pulse train pr(t) depicted in Fig. 5.7b, being a periodic signal, 
can be expressed as a trigonometric Fourier series 


oo 
pr(t) = Co + D Cncos (nwst+ On) ws= = 


n=1 
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Fig. 5.8 An example of practical sampling. 


and 


F(t) = f(t)pr(t) = f(t) [co + D Cn cos (nwst + oa) 


n=1 


= Cof(t)+ S cnf (t) cos (nwst + On) (5.11) 


n=l 


The sampled signal f(t) consists of Cof (t), Cif (t) cos (wst + 01), Caf (t) cos (2wst + 
62), .... Note that the first term Cof (t) is the desired signal and all the other terms 
are modulated signals with spectra centered at ws, +2w,, t3w.,..., as illustrated 
in Fig. 5.7e. Clearly the signal f(t) can be recovered by lowpass filtering of f(t), 
provided that ws > 4r B (or Fs > 2B). 


E Example 5.3 

To demonstrate practical sampling, consider a signal f(t) = sinc?(5mt) sampled by a 
rectangular pulse sequence pr(t) illustrated in Fig. 5.8c. The period of pr(t) is 0.1 second, 
so that the fundamental frequency (which is the sampling frequency) is 10 Hz. Hence, 
ws = 207. The Fourier series for pr(t) can be expressed as 


co 
pr(t) = Co + Don cos nwst 


n=1 


330 5 Sampling 


PAG) 


t— (a) The signal 


(b) The PAM signal 
Pulse locations 
are the same but 
their widths 
(c) The PWM (PDM) signai 
to 
Pulse widths are 
the same but 
«~~~ their locations 
change. 
(d) The PPM signal 
Fig. 5.9 Pulse modulated signals. 
Use of Eqs. (3.66) yields Co = } and Cn = % sin (22); that is, 
2 2 
Belge Cee cee Meets Gee. 
4 T T 3a õn 
Consequently 


F(t) =f(t)pr(t) = i f(t) + 2 f(t) cos 20rt + > f(t) cos 40rt + v2 Fy cos 60at +- 


and 

= 1 1 1 

=^ TE = — -4 F 4 
P(w) Fw) + ear 20r) + F(w + 207)} + oe [F(w — 407) + F(w + 407)] 
1 
+ — [Fw — 607) + F(w + 60r) + 
a Ja! ( )+ F( )] 

In the present case F(w) = 0.2A(34). The spectrum F(w) is depicted in Fig. 5.8e. 


Observe that the spectrum consists of F'(w) repeating periodically at the interval of 207 
rad/s (10 Hz). Hence, there is no overlap between cycles, and F(w) can be recovered by 
using an ideal lowpass filter of bandwidth 5 Hz. An ideal lowpass filter of unit gain (and 
bandwidth 5 Hz) will allow the first term on the right-side of the above equation to pass 
fully and suppress all the other terms. Hence, the output y(t) is 


w=7/0 m 
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5.1-3 Some Applications of the Sampling Theorem 


The sampling theorem is very important in signal analysis, processing, and 
transmission because it allows us to replace a continuous-time signal by a discrete 
sequence of numbers. Processing a continuous-time signal is therefore equivalent 
to processing a discrete sequence of numbers. Such processing leads us directly 
into the area of digital filtering. In the field of communication, the transmission 
of a continuous-time message reduces to the transmission of a sequence of numbers 
using pulse trains. The continuous-time signal f(t) is sampled, and sample values 
are used to modify certain parameters of a periodic pulse train. We may vary the 
amplitudes (Fig. 5.9b), widths (Fig. 5.9c), or positions (Fig. 5.9d) of the pulses in 
proportion to the sample values of the signal f(t). Accordingly, we have pulse- 
amplitude modulation (PAM), pulse-width modulation (PWM), or pulse 
position modulation (PPM). The most important form of pulse modulation today 
is pulse code modulation (PCM), discussed below. In all these cases, instead of 
transmitting f(t), we transmit the corresponding pulse-modulated signal. At the 
receiver, we read the information of the pulse-modulated signal and reconstruct the 
analog signal f(t). 


fO 


Fig. 5.10 Time-division multiplexing of two signals. 


One advantage of using pulse modulation is that it permits the simultaneous 
transmission of several signals on a time-sharing basis (time-division multiplex- 
ing, or TDM). Because a pulse-modulated signal occupies only a part of the chan- 
nel time, we can transmit several pulse-modulated signals on the same channel by 
inter- 
weaving them. Figure 5.10 shows the TDM of two PAM signals. In this manner, 
we can multiplex several signals on the same channel by reducing pulse widths. 


Another method of transmitting several baseband signals simultaneously is 
frequency-division multiplexing (FDM), discussed in Sec. 4.8-4. In FDM various 
signals are multiplexed by sharing the channel bandwidth. The spectrum of each 
message is shifted to a specific band not occupied by any other signal. The informa- 
tion of various signals is located in nonoverlapping frequency bands of the channel 
(Fig. 4.45). In a way, TDM and FDM are the duals of each other. 
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Pulse Code Modulation (PCM) 


PCM is the most useful and widely used of all the pulse modulations mentioned. 
Basically, PCM is a method of converting an analog signal into a digital signal (A/D 
conversion), An analog signal is characterized by the fact that its amplitude can 
take on any value over a continuous range. Hence, analog signal can take on an 
infinite number of values. In contrast, a digital signal amplitude can take on only 
a finite number of values. An analog signal can be converted into a digital signal 
by means of sampling and quantizing (rounding off). Sampling an analog signal 
alone will not yield a digital signal because a sampled analog signal can still take on 
any value in a continuous range. It is digitized by rounding off its value to one of 
the closest permissible numbers (or quantized levels), as illustrated in Fig. 5.11a. 
The amplitudes of the analog signal f(t) lie in the range (-V,V). This range is 
partitioned into L subintervals, each of magnitude Av = 2V/L. Next, each sample 
amplitude is approximated by the midpoint value of the subinterval in which the 
sample falls (see Fig. 5.11a for L = 16). It is clear that each sample is approximated 
to one of the L numbers. Thus, the signal is digitized with quantized samples taking 
on any one of the L values. Such a signal is known as an L-ary digital signal. 

From a practical viewpoint, a binary digital signal (a signal that can take on 
only two values) is very desirable because of its simplicity, economy, and ease of 
engineering. We can convert an L-ary signal into a binary signal by using pulse 
coding. Figure 5.11b shows such a code for the case of L = 16. This code, formed 
by binary representation of the 16 decimal digits from 0 to 15, is known as the 
natural binary code (NBC). Other possible ways of assigning a binary code 
exist. Each of the 16 levels to be transmitted is assigned one binary code of four 
digits. Thus, each sample in this example is encoded by four binary digits. To 
transmit this binary data, we need to assign a distinct pulse shape to each of the 
two binary states. One possible way is to assign a negative pulse to a binary 0 and 
a positive pulse to a binary 1 so that each sample is now transmitted by a group of 
four binary pulses (pulse code), as depicted in Fig. 5.11b. The resulting signal is a 
binary PCM signal. The analog signal f(t) is now converted to a (binary) digital 
signal. A binary digit is called bit for convenience. This contraction of binary digit 
by bit has become an industry standard abbreviation. 

The audio signal bandwidth is about 15 kHz, but subjective tests show that 
signal articulation (intelligibility) is not affected if all the components above 3400 Hz 
are suppressed.*} Since the objective in telephone communication is intelligibility 
rather than high fidelity, the components above 3400 Hz are eliminated by a lowpass 
filter. The resulting signal is then sampled at a rate of 8000 samples per second (8 
kHz). This rate is intentionally kept higher than the Nyquist sampling rate of 6.8 
kHz to avoid unrealizable filters required for signal reconstruction. Each sample is 
finally quantized into 256 levels (L = 256), which requires a group of eight binary 
pulses to encode each sample (2° = 256). Thus, a digitized telephone signal consists 
of 8 x 8000 = 64000 or 64 kbits/s data, requiring 64,000 binary pulses per second 
for its transmission. 

The compact disc (CD) is a recent application of PCM. This is a high-fidelity 
situation requiring the audio signal bandwidth of 15 kHz. Although the Nyquist 
sampling rate is only 30 kHz, an actual sampling rate of 44.1 kHz is used for the 


{Components below 300 Hz may also be suppressed without affecting the articulation. 
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Fig. 5.11 Analog-to-digital (A/D) conversion of a signal. 
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reason mentioned earlier. The signal is quantized into a rather large number of 
levels (L = 65, 536) to reduce quantizing error. The binary-coded samples are now 
recorded on the CD. 


Advantages of Digital Signals 
Some of the advantages of digital signals over analog signals are listed below: 


1. Transmission of digital signals is more rugged than that of analog signals be- 
cause digital signals can withstand channel noise and distortion much better 
as long as the noise and the distortion are within limits. The digital (binary) 
message in Fig. 5.12a is distorted by the channel, as illustrated in Fig. 5.12b. 
Yet if the distortion remains within a limit, we can recover the data without 
error because we need only to make a simple binary decision as to whether the 
received pulse is positive or negative. Figure 5.12c shows the same data with 
channel distortion and noise. Here again the data can be recovered correctly as 
long as the distortion and the noise are within limits. Such is not the case with 
analog messages. Any distortion or noise, no matter how small, will distort the 
received signal. 


(a) 


(b) 


(c) 


(d) 


Fig. 5.12 Digital signal: (a) transmitted (b) received distorted signal (without noise) 
(c) received distorted signal (with noise) (d) regenerated signal at the receiver. 


2. The greatest advantage of digital signal transmission over analog transmission, 
however, is the viability of regenerative repeaters in the former. In an analog 
transmission system, a message signal, as it travels along the channel (trans- 
mission path), grows progressively weaker, whereas the channel noise and the 
signal distortion, being cumulative, become progressively stronger. Ultimately 
the signal, overwhelmed by noise and distortion, is mutilated. Amplification is 
of little help because it enhances the signal and the noise in the same proportion. 
Consequently, the distance over which an analog message can be transmitted 
is limited by the transmitted power. If a transmission path is long enough, the 
channe? distortion and noise will accumulate sufficiently to overwhelm even a 
digital signal. The trick is to set up repeater stations along the transmission 
path at distances short enough to be able to detect signal pulses before the noise 
and distortion have a chance to accumulate sufficiently. At each repeater sta- 
tion the pulses are detected, and new, clean pulses are transmitted to the next 
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repeater station, which, in turn, duplicates the same process. If the noise and 
distortion remain within limits (which is possible because of the closely spaced 
repeaters), pulses can be detected correctly.j This way the digital messages 
can be transmitted over longer distances with greater reliability. In contrast, 
analog messages cannot be cleaned up periodically, and the transmission is 
therefore less reliable. The most significant error in PCM comes from quantiz- 
ing. This error can be reduced as much as desired by increasing the number of 
quantizing levels, the price of which is paid in an increased bandwidth of the 
transmission medium (channel). 

3. Digital hardware implementation is flexible and permits the use of micropro- 
cessors, miniprocessors, digital switching, and large-scale integrated circuits. 

4. Digital signals can be coded to yield extremely low error rates and high fidelity, 
as well as privacy. Also, more sophisticated algorithms can be used to process 
digital signals. 

5. It is easier and more efficient to multiplex several digital signals. 


6. Digital signal storage is relatively easy and inexpensive. It also has the ability 
to search and select information from distant electronic storehouses. 

7. Reproduction with digital messages is extremely reliable without deterioration. 
Analog messages such as photocopies and films, for example, lose quality at 
each successive stage of reproduction, and have to be transported physically 
from one distant place to another, often at relatively high cost. 

8. The cost of digital hardware continues to halve every two or three years, while 
performance or capacity doubles over the same time period. And there is no 
end in sight yet to this breathtaking and relentless exponential progress in 
digital technology. In recent years we have seen the compact disc—a digital 
device—bury the analog long-playing record; newspapers transmit photographs 
in scanned digital form; and more recently the shift in the United States toward 
a digital standard for high-definition television as opposed to the analog stan- 
dard embraced by Japan and Europe. In contrast, analog technologies such as 
paper, video, sound, and film do not decline rapidly in cost. If anything, they 
become more expensive with time. For these and other reasons, it is only a 
matter of time before cost/performance curves cross, and digital technologies 
come to dominate in any given area of communication or storage technologies. 


As mentioned earlier, digital signals come from a variety of sources. Some 
sources such as computers are inherently digital. Some sources are analog, but are 
converted into digital form by a variety of techniques such as PCM modulation. 

A Exercise E5.2 
American Standard Code for Information Interchange (ASCII) has 128 characters which are 


binary coded. A certain computer generates 100,000 characters/s. Show that 
(a) 7 bits (binary digits) are required to encode each character. 


(b) 700,000 bits/s are required to transmit the computer output. Y 


A Historical Note 
Gottfried Wilhelm Leibnitz (1646-1716) was the first mathematician to work 
out systematically the binary representation (using 1’s and 0’s) for any number. 


{The error in pulse detection can be made negligible. 
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He felt a spiritual significance in this discovery, reasoning that 1 representing unity 
was clearly a symbol for God, while 0 represented the nothingness. Therefore, if all 
numbers can be represented merely by the use of 1 and 0, surely this is the same 
as saying that God created the universe out of nothing! 


5.1-4 Dual of the Time-Sampling: The Spectral Sampling Theorem 


As in other cases, the sampling theorem has its dual. In Sec. 5.1, we discussed 
the time-sampling theorem where we showed that a signal bandlimited to B Hz can 
be* reconstructed from the signal samples taken at a rate of Fa > 2B samples/s. 
Note that the signal spectrum exists over the frequency range —B to B Hz. There- 
fore, 2B is the spectral width (not the bandwidth, which is B) of the signal. This 
fact means that a signal f(t) can be reconstructed from samples taken at a rate F, 
greater than the spectral width (in Hz) of the signal. 

The dual of the time-sampling theorem is the frequency-sampling theorem. 
This theorem applies to timelimited signals, which are duals of bandlimited signals. 
We now prove that the spectrum F(w) of a signal timelimited to 7 seconds can be 
reconstructed from the samples of F(w) taken at a rate R > r (the signal width) 
samples per Hertz. 

Figure 5.13a shows a signal f(t) that is timelimited to r seconds along with its 
Fourier transform F(w). Although F(w) is complex in general, it is adequate for 
our line of reasoning to show F(w) as a real function. 


I F~ 
F: = —_— 
(b) oT, 
Fig. 5.13 Periodic repetition of a signal amounts to sampling its spectrum. 
Oe. r E . 
F(w) = f f(t)e dt = f f(t)e“" dt (5.12) 
-00 0 ij 


We now construct fr,(t), a periodic signal formed by repeating f(t) every To 
seconds (Tp > r), as depicted in Fig. 5.13b. This periodic signal can be expressed 
by the exponential Fourier series 


oo 
mos So Diet’ wo 


n=- 


_ m 
=7 
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where (assuming 7 < To) 


1 ft EA 1 7 ar 
Da = — t)eInwot dt = xf tJe iot ge 
=F I F(t) Toh f(t) 


From Eq. (5.12) it follows that 


D= EP (no) 

This result indicates that the coefficients of the Fourier series for fr, (t) are (1/To) 
times the sample values of the spectrum F(w) taken at intervals of wọ. This means 
that the spectrum of the periodic signal f7,(t) is the sampled spectrum F(w), as 
illustrated in Fig. 5.13b. Now as long as 7 < To, the successive cycles of f(t) 
appearing in f7,(t) do not overlap, so that f(t) can be recovered from fr,(t). Such 
recovery implies indirectly that F(w) can be reconstructed from its samples. These 
samples are separated by the fundamental frequency Fo = 1/Tp Hz of the periodic 
signal fy,(t). The condition for recovery is that Tp > 7; that ist 


1 
Fo < — Hz 
T 
Therefore, to be able to reconstruct the spectrum F(w) from the samples of F (w), 


the samples should be taken at frequency intervals not greater than Fy = 1/r Hz. 
If R is the sampling rate (samples/Hz), then 


1 
R= — > 7 samples/Hz (5.13) 
Fo 
Spectral Interpolation 
The spectrum F(w) of a signal f(t) timelimited to r seconds can be recon- 
structed from the samples of F (w). For this case, using the dual of the approach 


employed to derive the signal interpolation formula in Eq. (5.10), we obtain the 
spectral interpolation formula 


F (w) = Ñ` F (nwo) sinc (= = nn) wee = (5.14) 


E Example 5.4 
The spectrum F(w) of a unit duration signal f(t) is sampled at the intervals of 1 Hz 
or 2x rad/s (the Nyquist rate). The samples are: 


F(0)=1 and F(+2rn)=0 (n =1, 2, 3,...) 


We use the interpolation formula (5.14) to construct F(w) from its samples. Since all 
but one of the Nyquist samples are zero, only one term (corresponding to n = 0) in the 
summation on the right-hand side of Eq. (5.14) survives. Thus, with F(0) = 1 and 7 = 1, 
we obtain 


F(w) = sinc (2) (5.15) 


For a signal of unit duration this is the only spectrum with the sample values F(0) = 1 
and F(2mn) = 0 (n #0). No other spectrum satisfies these conditions. W 


{This result assumes that f(t) does not have impulses at t = 0 or r. If impulses do occur, then 
Fo < ifr. 
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5.2 Numerical Computation of the Fourier Transform: 
The Discrete Fourier Transform (DFT) 


Numerical computation of the Fourier transform of f(t) requires sample values 
of f(t) because a digital computer can work only with discrete data (sequence of 
numbers). Moreover, a computer can compute F(w) only at some discrete values 
of w [samples of F(w)]. We therefore need to relate the samples of F(w) to samples 
of f(t). This task can be accomplished by using the results of the two sampling 
theorems developed in Sec. 5.1. 

We begin with a timelimited signal f (t) (Fig. 5.14a) and its spectrum F (w) (Fig. 
5.14b). Since f (t) is timelimited, F(w) is nonbandlimited. For convenience, we shall 
show all spectra as functions of the frequency variable F (in Hertz) rather than w. 
According to the sampling theorem, the spectrum F(w) of the sampled signal f(t) 
consists of F (w) repeating every F, Hz where Fs = 1/T. This is depicted in Figs. 
5.l4c and 5.14d.¢ In the next step, the sampled signal in Fig. 5.14c is repeated 
periodically every To seconds, as illustrated in Fig. 5.14e. According to the spectral 
sampling theorem, such an operation results in sampling the spectrum at a rate 
of To samples per Hz. This sampling rate means that the samples are spaced at 
Fo =1/To Hz, as depicted in Fig. 5.14f. 

The above discussion shows that, when a signal f(t) is sampled and then pe- 
riodically repeated, the corresponding spectrum is also sampled and periodically 
repeated. Our goal is to relate the samples of f(t) to the samples of F (w). 


Number of Samples 


One interesting observation in Figs. 5.14e and 5.14f is that No, the number of 
samples of the signal in Fig. 5.14e in one period To is identical to Nj, the number 
of samples of the spectrum in Fig. 5.14f in one period F,. The reason is 


F 
No = zo and N= = (5.16a) 
T o 
But, because 
1 1 
Fs; = T and Fo = To (5.16b) 
To Fs , 
Ame TTF, 0 (5.16c) 


Aliasing and Leakage in Numerical Computation 


Figure 5.14f shows the presence of aliasing in the samples of the spectrum 
F(w). This aliasing error can be reduced as much as desired by increasing the 
sampling frequency F, (decreasing the sampling interval T = =); The aliasing 
can never be eliminated for timelimited f(t), however, because its spectrum F (w) is 
nonbandlimited. Had we started out with a signal having a bandlimited spectrum 
F(w), there would be no aliasing in the spectrum in Fig. 5.14f. Unfortunately such 


{There is a multiplying constant 1/T for the spectrum in Fig. 5.14d [see Eq. (5.4)], but this is 
irrelevant to our discussion here. 


5.2 Numerical Computation of the Fourier Transform: The DFT 


“wins}oeds sy Jo uonadax o1poued pue Surduzes ur synsax yeudis e Jo uopyadas s1pouad pue Suydwes pr's 3y 


(a) 


Q) 


(e) 


(9) 


-t 


(ns 


(9) 4 


339 


340 5 Sampling 


a signal is nontimelimited and its repetition (in Fig. 5.14e) would result in signal 
overlapping (aliasing in the time domain). In this case we shall have to contend 
with errors in signal samples. In other words, in computing the direct or inverse 
Fourier transform numerically, we can reduce the error as much as we wish, but the 
error can never be eliminated. This fact is true of numerical computation of direct 
and inverse Fourier transforms, regardless of the method used. For example, if we 
determine the Fourier transform by direct integration numerically, using Eq. (4.8a), 
there will be an error because the interval of integration At can never be made 
zero. Similar remarks apply to numerical computation of the inverse transform. 
Therefore, we should always keep in mind the nature of this error in our results. 
In our discussion (Fig. 5.14), we assumed f(t) to be a timelimited signal. If f(t) 
is not timelimited, we would need to timelimit it because numerical computations 
can work only with finite data. Further, this data truncation causes error because 
of spectral spreading (smearing) and leakage, as discussed in Sec. 4.9. The leakage 
also causes aliasing. Leakage can be reduced by using a tapered window for signal 
truncation. But this choice increases spectral spreading or smearing. The spectral 
spreading can be reduced by increasing the window width (i.e. more data), which 
increases To, and reduces Fo (increases spectral or frequency resolution). 


Picket Fence Effect 


The numerical computation method yields only the uniform sample values of 
F(w) for f(t)]. Using this method is like viewing a signal and its spectrum through a 
“picket-fence.” The major peaks of F (w) [or f (t)] could lie between two samples and 
may remain hidden, a situation giving a false picture of the reality. Such misleading 
results can be avoided by using a sufficiently large No, the number of samples, which 
increases resolution. We can also use the spectral interpolation formula [Eq. (5.14)| 
to determine the values of F(w) between samples. 


Derivation of the Discrete Fourier transform (DFT) 


If f(kT) and F (rwo) are the kth and rth samples of f(t) and F (w), respectively, 
then we define new variables fẹ and F, as 


fk =TFf(kT) 
= 20 per) (5.17a) 
K ; 
and 
F, = F(rwo) (5.17b) 
where 
2 
wo = aF, = 2 (5.170) 
To 


We shall now show that f, and F, are related by the following equations:t 


tIn Eqs. (5.18a) and (5.18b), the summation is performed from 0 to No — 1. It is shown in Eq. 


(10.12) that the summation may be performed over any successive No values of k or r. 
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No-1 
Fee fee Me (5.18a) 
=0 
pele 2 
f= Yo Felt =T= E i 
No > r 0 = wo No (5.18b) 


These equations define the direct and the inverse discrete Fourier transforms 
(DFT), with F, the direct discrete Fourier transform (DFT) of fp, and fe the 
inverse discrete Fourier transform (IDFT) of F,. The notation 


fk => Fr 

is also used to indicate that fẹ and F, are a DFT pair. Remember that fp is To/No 
times the kth sample of f(t) and F, is the rth sample of F (w). Knowing the sample 
values of f(t), we can compute the sample values of F(w)—and vice versa—using 
the DFT. Note, however, that fẹ is a function of k (k = 0,1,2,...,No — 1) rather 
than of t and that F, is a function of r (r = 0,1,2,...,No — 1) rather than of 
w. Moreover, both fg and F, are periodic sequences of period No (Figs. 5.14e and 
5.14f). Such sequences are called No-periodic sequences. The proof of the DFT 
relationships in Eqs. (5.18) follows directly from the results of the sampling theorem. 
The sampled signal f(t) (Fig. 5.14c) can be expressed as 


No~1 


F(t)= J f(e)6 (t- kT) (5.19) 


k=0 


Since 6 (t — kT) 4 eT the Fourier transform of Eq. (5.19) yields 


No-1 
Fw) = JO ST) (5.20) 
k=0 


But from Fig. 5.le for Eq. (5.4)], it is clear that over the interval |w| < 4, F(w), 
the Fourier transform of f(t) is Fw assuming negligible aliasing. Hence 


No-1 


Fw) =TFw)=T Y f(kT)e OT ws = 
k=0 2 
and 
No-1 
F, = F(rwo) =T > f (kT )e rot (5.21) 
k=0 


If we let woT = Qo, then from Eqs. (5.16a) and (5.16b) 


Q = woT = In FT = — (5.22) 
9) 


Also, from Eq. (5.17a), 
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Therefore, Eq. (5.21) becomes 


= 5 jrQok = oe (5.23) 
—jrNo 5 
F; 2. fre Qo No 


The inverse transform relationship (5.18b) could be derived by using a similar 
procedure with the roles of t and w reversed, but here we shall use a more direct 
proof. To prove the inverse relation in Eq. (5.18b), we multiply both sides of Eq. 
(5.23) by er and sum over r as 


No-1 No~1 [No-1 , m 
D FpeI Mor = No Se fpe ITSF eiMMor 
r=0 r=0 k=0 


By interchanging the order of summation on the right hand side 


No-1 No—1 No—1 
D F eTO — y fr Ss ef (m—k)Qor 
x 
r=0 k=0 r=0 
Appendix 5.1 shows that the inner sum on the right hand side is zero for k # m, 
and that the sum is No when k = m. Therefore the outer sum will have only one 
nonzero term when k = m, and it is Nofy = Nofm. Therefore 


; Qn 
Q = 
fa= No eer Qo = No (5.24) 
Because F, is No-periodic, we need to determine the values of F over any one 
period. It is customary to determine F, over the range (0, No — 1) rather than over 
the range (-‘, No —1).4 


Choice of T, To, and No 


In DFT computation, we first need to select suitable values for No, T, and To. 
For this purpose we should first decide on B, the essential bandwidth (in hertz) of 
the signal. The sampling frequency Fs must be at least 2B; that is, 


a >B (5.25a) 
Moreover, the sampling interval T = F [Eq. (5.16b)], and 

T< 5 (5.25b) 
Once we pick B, we can choose T according to Eq. (5.25b)). Also, 

F= ž (5.26) 


where F, is the frequency resolution [separation between samples of F(w)}. 
Hence, if F, is given, we can pick To according to Eq. (5.26). Knowing To and 
T, we determine No from 

{The DFT relationships represent a transform in their own right, and they are exact. If, however, 


i i i i i form F(w), respectively, 
we identify fk and F, as the samples of a signal f(t) and of its Fourier trans: 
then the neb relationships are approximations because of the aliasing and leakage effects. 
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No= > (5.27) 


Points of Discontinuity 

If f(t) has a jump discontinuity at a sampling point, the sample value should 
be taken as the average of the values on the two sides of the discontinuity because 
the Fourier representation at a point of discontinuity converges to the average value. 


Zero Padding 


Recall that observing F, is like observing the spectrum F (w) through a “picket- 
fence.” If the frequency sampling interval F, is not sufficiently small, we could miss 
out on some significant details and obtain a misleading picture. To obtain a higher 
number of samples, we need to reduce Fo. Because Fo = 1/To, a higher number 
of samples requires us to increase the value of To, the period of repetition for f(t). 
This option increases No, the number of samples of f (t), by adding dummy samples 
with a value of 0. This addition of dummy samples is known as zero padding. 
Thus, zero padding increases the number of samples and may help in getting a 
better idea of the spectrum F(w) from its samples F,. 


Zero Padding Does Not Improve Accuracy or Resolution 

One point should be understood clearly: that zero padding merely gives us more 
samples without improving the accuracy of those sample values. Zero padding will 
be useful only if the sampling interval T is sufficiently small so that the aliasing error 
is negligible. If there is a good deal of aliasing to begin with, zero padding will merely 
give us more samples of the garbage. It can never improve accuracy or frequency 
resolution in a true sense. The accuracy can be increased only by reducing aliasing, 
which requires reduction in the signal sampling interval T (T < 1/2B, where B is 
the effective bandwidth of the signal). 


E Example 5.5 

A signal f(t) has a duration of 2 ms and an essential bandwidth of 10 kHz. It is 
desirable to have a frequency resolution of 100 Hz in the DFT (Fo = 100). Determine No. 

The effective signal duration To is given by 

1 1 
To = Z = w” 10 ms 

Since the signal duration is only 2 ms, we need zero padding over 8 ms. Also, B = 10,000. 
Hence, F, = 2B = 20,000 and T = 1/F, = 50 ps. Further, 
_ Fs _ 20,000 
~ Fo 100 


The fast Fourier transform (FFT) algorithm (discussed in Sec. 5.3) is used to compute 
DFT, where it proves convenient (although not necessary) to select No as a power of 2; 
that is, No = 2” (n, integer). Let us choose No = 256. Increasing No from 200 to 256 can 
be used to reduce aliasing error (by reducing T), to improve resolution (by increasing To) 
or a combination of both. 


No 


= 200 


` 


(i) Reducing aliasing error: We maintain the same To so that F, = 100. Hence 


Fe = NoFo = 256 x 100 = 25600 and T= = = 39 us 
$ 
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Thus, increasing No from 200 to 256 permits us to reduce the sampling interval T from 
50 us to 39 us while maintaining the same frequency resolution (Fo = 100). 


(ii) Improving resolution: Here we maintain the same T = 50 ys, which yields 
To = NoT = 256(50x 107°) = 12.8 ms and F= = = 78.125 Hz 
0 


Thus, increasing No from 200 to 256 can improve the frequency resolution from 100 to 
78.125 Hz while maintaining the same aliasing error (T = 50 ps). 


(iii) Combination of these two options 
We could choose T = 45 us and To = 11.5 ms so that Fo = 86.96 Hz. a 


@ Example 5.6 

Use DFT to compute the Fourier transform of e 
spectra. 

We first determine T and To. The Fourier transform of e~*‘u(t) is 1/(jw + 2). This 
lowpass signal is not bandlimited. In Sec. 4.6, we used the energy criterion to compute the 
essential bandwidth of a signal. Here, we shall present a simpler, but workable alternative 
to the energy criterion. The essential bandwidth of a signal will be taken as that frequency 
where |F(w)| reduces to 1% of its peak value (see footnote on p. 276). In this case, the 
peak value occurs at w = 0, where |F(0)| = 0.5. Observe that 


—2tu(t). Plot the resulting Fourier 


1 1 
Voti w 
Also, 1% of the peak value is 0.01 x 0.5 = 0.005. Hence, the essential bandwidth B is at 
w = 2r B, where 


|F(w)| = w > 2 


1 100 
and from Eq. (5.25b), 
1 T 
<a oe E 
TS 25 = 300 0.015708 


Had we used 1% energy criterion to determine the essential bandwidth, following the 
procedure in Example 4.16, we would have obtained B = 20.26 Hz, which is somewhat 
smaller than the value just obtained by using 1% amplitude criterion. 

The second issue is to determine To. Because the signal is not timelimited, we have 
to truncate it at To such that f(Zo) < 1. A reasonable choice would be To = 4 because 
f(4) = e7? = 0.000335 « 1. The result is No = To/T = 254.6, which is not a power of 2. 
Hence, we choose To = 4, and T = 0.015625 = 1/64, yielding No = 256, which is a power 
of 2. 

Note that there is a great deal of flexibility in determining T and To, depending on 
the accuracy desired and the computational capacity available. We could just as well have 
chosen T = 0.03125, yielding No = 128, although this choice would have given a slightly 
higher aliasing error. 

Because the signal has a jump discontinuity at t = 0, the first sample (at t = 0) is 0.5, 
the averages of the values on the two sides of the discontinuity. We compute F, (the DFT) 
from the samples of e~*‘u(t) according to Eq. (5.18a). Note that F, is the rth sample of 
F(w), and these samples are spaced at Fo = 1/To = 0.25 Hz. (wo = 1/2 rad/s.) 

Because F, is No-periodic, Fp = Fi-+4256) so that Foss = Fo. Hence, we need to 
plot F, over the range r = 0 to 255 (not 256). Moreover, because of this periodicity, 
F_, = F(-r4256), and the values of F, over the range r = —127 to —1 are identical to 
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those over the range r = 129 to 255. Thus, F_127 = Fie9, F-126 = Fiso, ...F-1 = Fass. 
In addition, because of the property of conjugate symmetry of the Fourier transform, 
F_, = F7, it follows that F—ı = Ff, F_2 = F}, ..., F-128 = Figg. Thus, we need F, only 
over the range r = 0 to No/2 (128 in this case). 

Figure 5.15 shows the plots of |F,| and ZF, and the exact magnitude and phase 
spectra (depicted by continuous curves) for comparison. Note the nearly perfect agreement 
between the two sets of spectra. We have depicted the plot of only the first 28 points rather 
than all the 128 point because it would have made the figure very crowded, resulting in 
loss of clarity. The points are at the intervals of 1/To = 1/4 Hz or wo = 1.5708 rad/s. The 
28 samples, therefore, exhibit the plots over the range w = 0 to w = 28(1.5708) = 44 rad/s 
or 7 Hz. 

In this example, we knew F(w) beforehand and hence could make intelligent choices 
for B (or the sampling frequency Fs). In practice, we generally do not know F(w) be- 
forehand. In fact, that is the very thing we are trying to determine. In such a case, we 
must make an intelligent guess for B or F, from circumstantial evidence. We should then 
continue reducing the value of T and recomputing the transform until the result stabilizes 
within the desired number of significant digits. The MATLAB program, which implements 
the DFT using the FFT algorithm, is presented in Example C5.1. W 


ZF (0) 


Exact 


FFT values 
Fig. 5.15 Discrete Fourier transform of an exponential signal e~?*u(t). 


© Computer Example C5.1 
Use DFT (implemented by the FFT, the fast Fourier transform algorithm) to compute 
the Fourier transform of e~**u(t). 


T=0.015625;TO=4;NO=T0/T; 
t=0:T:T*(NO-1);t=t’; 
f=T*exp(-2*t); 
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f(1)=T*0.5; 

F=fit(f); 
(Fp,Fm]=cart2pol(real(F),imag(F)); 
k=0:NO0-1; k=k’; 

w=2"pi*k/ T0; 

subplot (211), plot(w(1:128),Fm(1:128)) 
subplot (212) ,plot(w(1:128),Fp(1:128)) © 


E Example 5.7 

Use DFT to compute the Fourier transform of 8 rect (t). 

This gate function and its Fourier transform are illustrated in Fig. 5.16a and b. To 
determine the value of the sampling interval T, we must first decide on the essential 
bandwidth B. In Fig. 5.16b, we see that F(w) decays rather slowly with w. Hence, 
the essential bandwidth B is rather large. For instance, at B = 15.5 Hz (97.39 rad/s), 
F(w) = —0.1643, which is about 2% of the peak at F(0). Hence, the essential bandwidth 
is well above 16 Hz if we use the 1% criterion for computing the essential bandwidth. 
However, we shall deliberately take B = 4 for two reasons: (1) to show the effect of 
aliasing and (2) the use of B > 4 will give enormous number of samples, which cannot 
be conveniently displayed on the book size page without losing sight of the essentials. 
Thus, we shall intentionally accept approximation in order to clarify the concepts of DFT 
graphically. 

The choice of B = 4 results in the sampling interval T = z5 = 3, Looking again 
at the spectrum in Fig. 5.16b, we see that the choice of the frequency resolution Fo = 
Hz is pepeonanle: Such a choice gives us four samples in each lobe of F(w). In this case 
To = + = 4 seconds and No = p= = 32. The duration of f(t) is only 1 second. We Tunt 
tepesi. it every 4 seconds (To = WD, as depicted in Fig. 5.16c, and take samples every $ 
second. This choice yields 32 samples (No = 32). Also, 


fe =Tf(kT) 
1 
= ZST) 


Since f(t) = 8rect (t), the values of fx are 1, 0, or 0.5 (at the points of discontinuity), as 
illustrated in Fig. 5.16c. In this figure, fx is depicted as a function of t as well as k, for 
convenience. 

In the derivation of the DFT, we assumed that f(t) begins at t = 0 (Fig. 5.14a), 
and then took No samples over the interval (0, To). In the present case, however, f(t) 
begins at -4. This difficulty is easily resolved when we realize that the DFT obtained by 
this procedure is actually the DFT of fk repeating periodically every To seconds. Figure 
5.16c clearly indicates that repeating the segment of fx over the interval from —2 to 2 
seconds periodically is identical to repeating the segment of fy over the interval from 0 to 
4 seconds. Hence, the DFT of the samples taken from —2 to 2 seconds is the same as that 
of the samples taken from 0 to 4 seconds. Therefore, regardless of where f (t) starts, we 
can always take the samples of f(t) and its periodic extension over the interval from 0 to 
To. In the present example, the 32 sample values are 


1 O0<k<3 and 29<k<31 
fe= 40 5<k < 27 
0.5 k = 4,28 


Observe that the last sample is at t = 31/8, not at 4, because the signal repetition starts 
at t = 4, and the sample at t = 4 is the same as the sample at t = 0. Now, No = 32 and 
No = 27/32 = 1/16. Therefore [see Eq. (5.18a)] 
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FFT values 


(a) 


(b) 


28 32 36 


Fig. 5.16 Discrete Fourier Transform of a gate pulse. 
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31 
R= J fee iE 


k=0 


Values of F, are computed according to this equation and plotted in Fig. 5.16d. 

The samples F, are separated by Fo = % Hz. In this case To = 4, so the frequency 
resolution F, is ; Hz, as desired. The folding frequency a = B = 4 Hz corresponds to 
r= No = 16. Because F, is No-periodic (No = 32), the values of F, for r = —16 to 
n = —1 are the same as those for r = 16 ton = 31. For instance, Fi7 = F_is, Fig = F_1a, 
and so on. The DFT gives us the samples of the spectrum F(w). 

For the sake of comparison, Fig. 5.16d also shows the shaded curve 8sinc ($), which 
is the Fourier transform of 8 rect (t). The values of F, computed from DFT equation show 
aliasing error, which is clearly seen by comparing the two superimposed plots. The error in 
F; is just about 1.3%. However, the aliasing error increases rapidly with r. For instance, 
the error in Fg is about 12%, and the error in Fio is 33%. The error in Fy, is a whopping 
72%. The percent error increases rapidly near the folding frequency (r = 16) because f(t) 
has a jump discontinuity, which makes F(w) decays slowly as 1/w. Hence, near the folding 
frequency, the inverted tail (due to aliasing) is very nearly equal to F(w) itself. Moreover, 
the final values are the difference between the exact and the folded values (which are very 
close to the exact values). Hence, the percent error near the folding frequency (r = 16 in 
this case) is very high, although the absolute error is very small. Clearly, for signals with 
jump discontinuities, the aliasing error near the folding frequency will always be high (in 
percentage terms), regardless of the choice of No. To ensure a negligible aliasing error at 
any value r, we must make sure that No >> r. This observation is valid for all signals with 
jump discontinuities. Hl 


©) Computer Example C5.2 

Use DFT (implemented by the FFT algorithm) to compute the Fourier transform of 
8rect (t). Plot the resulting Fourier spectra. 

The MATLAB program, which implements this DFT equation using the FFT algo- 
rithm, is given next. First we write a MATLAB program to generate 32 samples of fk, 
and then we compute the DFT. 


% (c52.m) 

N0=32;k=0:N0-1; 

f=[ones(1,4) 0.5 zeros(1,23) 0.5 ones(1,3)]; 
Fr=fft(f); 

subplot(2,1,1),stem(k,f) 
xlabel(’k’);ylabel(’fk’); 

subplot (2,1,2),stem(k,Fr) 
xlabel(’r’);ylabel(’Fr’); © 


5.2-1 Some Properties of DFT 


The discrete Fourier transform is basically the Fourier transform of a sampled 
signal repeated periodically. Hence, the properties derived earlier for the Fourier 
transform apply to the DFT as well. 
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1. Linearity 


If fk <> F, and gk <= Gr, then 


aifk + azg9k 4> aif, +a2Gr (5.28) 
The proof is trivial. 


2. Conjugate Symmetry 


Fya-r = F," (5.29) 


This follows from the conjugate symmetry property of the Fourier transform (F* = 
F_,) and the periodic property of DFT (F_, = Fy,-,r). Because of this property, 
we need compute only half the DFTs for real f. The other half are the conjugates. 


3. Time Shifting (Circular Shifting) 


fren ==> he (5.30) 


Proof: Using Eq. (5.18b), we find the inverse DFT of F,e737%" as 


1 No-t . 1 No-1 
A D Fe7 3707 ejrNok = ra bD Fpeit@o(k-n) = fk-n 
r=0 r=0 


4. Frequency Shifting 


fke On e From (5.31) 


Proof: This proof is identical to that of the time shifting property except that 
we start with Eq. (5.18a). 


5. Circular (also called periodic) Convolution 


fk @ Gn > FG, (5.32a) 
and 
1 
fon => —F, @G, (5.32b) 
No 
For two No-periodic sequences fk and gx, the circular convolution is defined by 
No-1 No-1 
fe@ge= > frok-n= >> Infk-n (5.33) 
n=0 n=0 


To prove (5.32a), we find the DFT of circular convolution fk ® gk as 


No-1l /No—1 No-1 No-1l 
D 2 hae-n) e7iNok = 5 Ín 2 mannerta) 
k=0 n=0 n=0 k=0 

No—1 


a fn(Gre 27”) = F,G, 
n=0 


AA 
CY) S 


Fig. 5.17 Graphical picture of circular convolution. 


Equation (5.32b) can be proved in the same way. 

For nonperiodic sequences, the convolution can be visualized in terms of two 
sequences, where one sequence is fixed and the other sequence is inverted and moved 
past the fixed sequence, one digit at a time. If the two sequences are No-periodic, 
the same configuration will repeat after No shifts of the sequence. Clearly the 
convolution fe @ gz becomes No-periodic (circular), and such convolution can be 
conveniently visualized as illustrated in Fig. 5.17 for the case of No = 4. The inner 
sequence fk is clockwise and fixed. The outer sequence gẹ is inverted so that it 
becomes counterclockwise. This sequence is now rotated clockwise one unit at a 
time. We multiply the overlapping numbers and add. For example, the value of 
tk ® gp at k =O (Fig. 5.17) is 


fogo + figs + f292 + f391 
and the value of f ® gx at k = 1 is (Fig. 5.17) 


fog + figo + fogs + f392 
and so on. 


Applications of DFT 

The DFT is useful not only in the computation of direct and inverse Fourier 
transforms, but also in other applications such as convolution, correlation, and fil- 
tering. Use of the efficient FFT algorithm discussed in Sec. 5.3 makes it particularly 
appealing. 


Linear Convolution 

Let f(t) and g(t) be the two signals to be convolved. In general, these signals 
may have different time durations. To convolve them by using their samples, they 
must be sampled at the same rate (not below the Nyquist rate of either signal). 
Let fk (0 < k < Ni — 1) and gẹ (0 < k < No — 1) be the corresponding discrete 
sequences representing these samples. Now, 


c(t) = f(t) * g(t) 


and if we define three sequences as fk = Tf (kT), gk = Tg(kT), and ck = Tc(kT), 
then} 
Ck = fk * gk 


}We can show that? cp = limy—o fk * gk. Because T # 0 in practice, there will be some error in 
this equation. 
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where we define the linear convolution sum of two discrete sequences fg and gx as 


co 
fe* on = Z fnGk—-n 
n=—-ooO 

Because of the width property of the convolution, cz exists for 0 < k < Ni +No-1. 
To be able to use the DFT technique of circular convolution, we must make sure 
that the circular convolution will yield the same result as the linear convolution. 
In other words, the resulting signal of the circular convolution must have the same 
length (Ni + N2 — 1) as that of the signal resulting from linear convolution. This 
step can be accomplished by adding N2 — 1 dummy samples of zero value to f, and 
N; — 1 dummy samples of zero value to 9; (zero padding). This procedure changes 
the length of both fk and gẹ to be Ni + N2 — 1. The circular convolution now is 
identical to the linear convolution except that it repeats periodically with period 
Nı + N2 — 1. The rigorous proof of this statement is provided in Sec. 10.6-3. 

We can use the DFT to find the convolution fk * gx in three steps, as follows: 


1. Find the DFTs F, and G, corresponding to suitably padded fx and gp. 
2. Multiply F, by Gr. 
3. Find the IDFT of F,G,. This procedure of convolution, when implemented 


by the fast Fourier transform algorithm (discussed later), is known as the fast 
convolution. 


Filtering 


We generally think of filtering in terms of some hardware-oriented solution 
(namely, building a circuit with RLC components and operational amplifiers). How- 
ever, filtering also has a software-oriented solution [a computer algorithm that yields 
the filtered output y(t) for a given input f(t)]. This goal can be conveniently accom- 
plished by using the DFT. If f (t) is the signal to be filtered, then F,, the DFT of fk, 
is found. The spectrum F, is then shaped (filtered) as desired by multiplying F, by 
H,, where H, are the samples of the filter transfer function H (w) [Hy = H(rwo)}. 
Finally, we take the IDFT of F,H, to obtain the filtered output yg {yx = Ty(kT)]. 
This procedure is demonstrated in the following example. 


E Example 5.8 

The signal f(t) in Fig. 5.18a is passed through an ideal lowpass filter of transfer 
function H(w) depicted in Fig. 5.18b. Using DFT, find the filter output. 

We have already found the 32-point DFT of f(t) (see Fig. 5.16d). Next we multiply 
F, by Hy. To find H,, we recall using Fo = ; in computing the 32-point DFT of FAURE 
Because F, is 32-periodic, H» must also be 32-periodic with samples separated by ¢ Hz. 
This fact means that H, must be repeated every 8 Hz or 16r rad/s (see Fig. 5. 18c). The 
resulting 32 samples of H, over (0 < w < 167) are as follows: 


1 O<r<7 and 2<r<31 
H,=¢0 9<r<23 
0.5 r = 8,24 


We multiply F, with H,. The desired output signal samples yx are found by taking the 
inverse DFT of F H,. The resulting output signal is illustrated in Fig. 5.18d. Table 5.1 
gives a printout of fx, F,, Hr, Y-, and yx. Ml 
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Fig. 5.18 Filtering f(t) through H(w). 


© Computer Example C5.3 

Solve Example 5.8 using MATLAB. 

The MATLAB program of Example C5.2, where we obtained the 32-point Fr, should 
be saved as an m-file, e.g., ‘c52.m’. We can import F, in the MATLAB environment by 


the command ‘c52’. 


c52; 

N0=32;k=0:N0-1; 

H=[0nes(1,8) 0.5 zeros(1,15) 0.5 ones(1,7)]; 
Yr=H.*Fr; 

yk=ifft(Yr); 

stem(k,yk) © 


5.3 The Fast Fourier Transform (FFT) 


The number of computations required in performing the DFT was dramatically 
reduced by an algorithm developed by Tukey and Cooley in 1965.5 This algorithm, 
known as the Fast Fourier transform (FFT), reduces the number of computations 
from something of the order of NÈ to Nolog No. To compute one sample Fr from 
Eq. (5.18a), we require No complex multiplications and No — 1 complex additions. 
To compute No such values (F, for r = 0,1,...,No — 1), we require a total of Ne 
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0. 


complex multiplications and No(No — 1) complex additions. For a large No, these 
computations can be prohibitively time-consuming, even for a high-speed computer. 

Although there are many variations of the original Tukey-Cooley algorithm, 
these can be grouped into two basic types: decimation-in-time and decimation- 
in-frequency. The algorithm is simplified if we choose No to be a power of 2, 
although such a choice is not essential. For convenience, we define 


Wyo = 67 G27/No) = 95M (5.34) 
so that 
No-1 
Fe= Ù feWN OS r<No-1 (5.35a) 
and = 
1 No-1 
f= No 2, F,Wye”  0Sk<No-1 (5.35b) 
r= 


The Decimation-in-Time Algorithm 
Here we divide the No-point data sequence fk into two (42)-point sequences 
consisting of even- and odd-numbered samples respectively, as follows: 


fo, fas fás- -o FNo—2s fs £35 53-3 fNo—1 
er i a Ů 


sequence gk sequence hy 
Then, from Eq. (5.35a), 
Fo %1 
Fe= J JaW + YO fa WGO" (5.36) 
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r Fryd 
Fig. 5.19 Butterfly. 
Also, since 
Ww = Wi, (5.37) 
we have + ° 
F, = forW i, + Wh, D far W ey 
2 2 
k=0 k=0 
=Gr+Wp Hr O<r<No-1 (5.38) 


where G, and H, are the (42)-point DFTs of the even- and odd-numbered se- 
quences, gą and hp, respectively. Also, Gr and H,, being the (X2)-point DFTs, are 
( 42)-periodic. Hence 


G4 (Ma) = Gr 
Ay ( Na) = H, (5.39) 
Moreover, 
N N M 
wit?) -wE Wh =e WR = -Wh (5.40) 


From Eqs. (5.38), (5.39), and (5.40), we obtain 
Fg (4a) =Gr— WẸ, Hr (5.41) 
This property can be used to reduce the number of computations. We can compute 


the first (42) points (0 < n < M — 1) of F, using Eq. (5.38) and compute the last 
No points using Eq. (5.41) as 


N 
F,=Gr+Wh,Hr O<r< oa a4 (5.42a) 

r No 
FM) =ar- Wh OSrS 71 (5.42b) 


Thus, an No-point DFT can be computed by combining the two (2)-point DFTs, 
as in Eq. (5.42). These equations can be represented conveniently by the signal 
flow graph depicted in Fig. 5.19. This structure is known as a butterfly. Figure 
5.20a shows the implementation of Eqs. (5.39) for the case of No = 8. 

The next step is to compute the (¥42)-point DFTs G, and H,. We repeat 
the same procedure by dividing gx and A, into two (42)-point sequences corre- 
sponding to the even- and odd-numbered samples. Then we continue this process 
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Fig. 5.20 Successive steps in 8-point FFT. 
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until we reach the one-point DFT. Figures 5.20a, 5.20b, and 5.20c show these steps 
for the case of No = 8. Figure 5.20c shows that the two-point DFTs require no 
multiplication. 

To count the number of computations required in the first step, assume that 
G, and H, are known. Equations (5.42) clearly show that to compute all the No 
points of the F,., we require No complex additions and No complex multiplicationst 
(corresponding to Wy, Hr). 

In the second step, to compute the ( §o).point DFT G, from the (42)-point 
DFT, we require ‘a complex additions and Mo complex multiplications. We require 
an equal number of computations for H,. Hence, in the second step, there are No 
complex additions and Ao complex multiplications. The number of computations 
required remains the same in each step. Since a total of logy No steps is needed to 
arrive at a one-point DFT, we require, conservatively, a total of No logs No complex 
additions and (42) loga No complex multiplications, to compute the No-point DFT. 

The procedure for obtaining IDF'T is identical to that used to obtain the DFT 
except that Wy, = e7(2*/No) instead of e~7@*/No) (in addition to the multiplier 
1/No). Another FFT algorithm, the decimation-in-frequency algorithm, is sim- 
ilar to the decimation-in-time algorithm. The only difference is that instead of 
dividing f, into two sequences of even- and odd-numbered samples, we divide tre 
into two sequences formed by the first Xo and the last Xo digits, proceeding in the 
same way until a single-point DFT is reached in log, No steps. The total number 
of computations in this algorithm is the same as that in the decimation-in-time 
algorithm. 


5.4 Appendix 5.1 


We show that 


No—1 a m = 0, No, £2No, ... (5.43) 


5 eimQok = 
k=0 


Recall that NoNo = 2m and ef™9ok = 1 for m = 0, +No, +2No, .. ., so that 


No-i No~1 
edmQok = 5 l= No for m= 0,+No, +2No, ayers 
k=0 k=0 


0 otherwise 


To compute the sum for other values of m, we note that the sum on sue tet bane side 
of Eq. (5.43) is a geometric progression with common ratio œ = e/™'°. Therefore, 
(see Sec. B.7-4) 


No-1 jmNoNo _ : ; 
jmQok em =0 efm No = ei2nm = 1) 
$ eimo — 1 

k=0 


tActually, Xo is a conservative figure because some multiplications corresponding to the cases 


where Wio =1,j, etc., are eliminated. 
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5.5 Summary 


A signal bandlimited to B Hz can be reconstructed exactly from its samples 
if the sampling rate F, > 2B Hz (the sampling theorem). Such a reconstruction, 
although possible theoretically, poses practical problems such as the need for filters 
with zero gain over a band (or bands) of frequencies. Such filters are unrealizable, 
or realizable with infinite time delay. Therefore, in practice, there is always an error 
in reconstructing a signal from its samples. Moreover, practical signals are not ban- 
dlimited, which causes an additional error (aliasing error) in signal reconstruction 
from its samples. Aliasing error can be eliminated by bandlimiting a signal to its 
effective bandwidth. 

The sampling theorem is very important in signal analysis, processing, and 
transmission because it allows us to replace a continuous-time signal with a discrete 
sequence of numbers. Processing a continuous-time signal is therefore equivalent to 
processing a discrete sequence of numbers. This leads us directly into the area of 
digital filtering (discrete-time systems). In the field of communication, the trans- 
mission of a continuous-time message reduces to the transmission of a sequence of 
numbers. This opens doors to many new techniques of communicating continuous- 
time signals by pulse trains. 

The dual of the sampling theorem states that for a signal timelimited to 7 
seconds, its spectrum F(w) can be reconstructed from the samples of F(w) taken 
at uniform intervals not greater than 1/7 Hz. In other words, the spectrum should 
be sampled at a rate not less than r samples/Hz. 

To compute the direct or inverse Fourier transform numerically, we need a rela- 
tionship between the samples of f(t) and F(w). The sampling theorem and its dual 
provide such a quantitative relationship in the form of a discrete Fourier transform 
(DFT). The DFT computations are greatly facilitated by a fast Fourier transform 
(FFT) algorithm, which reduces the number of computations from something of the 
order of NÊ to No log No. 
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Problems 


5.1-1 Figure P5.1-1 shows Fourier spectra of signals fı(t) and fo(t). Determine the Nyquist 
sampling rates for signals f1(t), f(t), fi (t), f3(¢), and fr(t) fa(t). 
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5.1-2 


5.1-4 


5.1-5 


5.1-6 
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Fig. P5.1-1 


Determine the Nyquist sampling rate and the Nyquist sampling interval for the 
signals (a) sinc? (100nt) (b) 0.01 sinc? (1007t) (c) sinc (100mt) + 3 sinc” (60rt) (d) 
sinc (507t)sinc (100zt). 

A signal f(t) = sinc (200rt) is sampled (using uniformly spaced impulses) at a rate of 
(a) 150 Hz (b) 200 Hz (c) 300 Hz. For each of the three cases (i) sketch the spectrum 
of the sampled signal, (ii) explain if you can recover the signal f(t) from the sampled 
signal, (iii) if the sampled signal is passed through an ideal lowpass filter of bandwidth 
100 Hz, sketch the spectrum of the output signal. 

One realization of a practical zero-order hold circuit is presented in Fig. P5.1-4. 
(a)Find the unit impulse response of this circuit. Hint: Recall that the impulse 
response h(t) is the output of the circuit in Fig. P5.1-4 when the input f(t) = 6(t). 
(b)Find the transfer function H (w), and sketch |H(w)|. 

(c)Show that when a sampled signal F(t) is applied at the input of this circuit, the 
output is a staircase approximation of f(t). The sampling interval is T. 


Fig. P5.1-4 


(a) A first-order hold circuit can also be used to reconstruct a signal f (t) from its 
samples. The impulse response of this circuit is 


moma (fy) 


where T is the sampling interval. Consider a typical sampled signal F(t) and show 
that this circuit performs the linear interpolation. In other words, the filter output 
consists of sample tops connected by straight line segments. Follow the procedure 
discussed in Sec. 5.1-1 (Fig. 5.3b). 

(b) Determine the transfer function of this filter, and its amplitude response, and 
compare it with the ideal filter required for signal reconstruction. 

(c) This filter, being noncausal, is unrealizable. By delaying its impulse response, 
the filter can be made realizable. What is the minimum delay required to make 
it realizable? How would this delay affect the reconstructed signal and the filter 
frequency response? 

(d) Show that the filter in part (c) can be realized by a filter depicted in Fig. P5.1-4 
followed by an identical filter in cascade. Hint: show that the impulse response of 
this circuit is A(z) delayed by T seconds. 


A signal f(t) = sinc (200zt) is sampled by a periodic pulse train pr(t) resented in 
Fig. P5.1-6. Find and sketch the spectrum of the sampled signal. Explain if you 
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5.1-7 


5.1-8 


5.1-9 


4 ms 8 ms 
Fig. P5.1-6 


will be able to reconstruct f(t) from these samples. If the sampled signal is passed 
through an ideal lowpass filter of bandwidth 100 Hz and unit gain, find the filter 
output. What is the filter output if its bandwidth is B Hz, where 100 < B < 150? 
What will happen if the bandwidth exceeds 150 Hz? 


Fig. P5.1-7 Flat top sampling. 


In Example 5.3, the sampling of a signal f(t) was accomplished by multiplying the 
signal by a pulse train pr(t), resulting in the sampled signal depicted in Fig. 5.8d. 
This procedure is known as the natural sampling. Figure P5.1-7 shows the so called 
flat top sampling of the same signal f(t) = sinc ?(5rt). 

(a) Show that the signal f(t) can be recovered from flat top samples if the sampling 
rate is no less than the Nyquist rate. 

(b) Explain how you would recover f(t) from the flat top samples. 

(c) Find the expression for the sampled signal spectrum F(w) and sketch it roughly. 
Hint: First show that the flat top sampled signal can be generated by passing the 
signal f(t)6r(t) through a filter whose impulse response is h(t) = pr(t). For signal 
recovery from the samples, follow the reverse procedure. 


A compact disc (CD) records audio signals digitally by using PCM. Assume the audio 
signal bandwidth to be 15 kHz. 


(a) What is the Nyquist rate? 

(b) If the Nyquist samples are quantized into 65536 levels (L = 65536) and then 
binary-coded, what number of binary digits is required to encode a sample. 

(c) rig the number of binary digits/s (bits/s) required to encode the audio 
signal. 

(da) For practical reasons discussed in the text, signals are sampled at a rate well 
above the Nyquist rate. Practical CDs use 44100 samples/s. If L = 65536, determine 
the number of pulses/s required to encode the signal. 


A TV signal (video and audio) has a bandwidth of 4.5 MHz. This signal is sampled, 
quantized and binary-coded to obtain a PCM (pulse code modulated) signal. 

(a) Determine the sampling rate if the signal is to be sampled at a rate 20% above 
the Nyquist rate. 

(b) If the samples are quantized into 1024 levels, what number of binary pulses is 
required to encode each sample. 


(c) Determine the binary pulse rate (bits/s) of the binary coded signal. 
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-10 Prove that a signal cannot be simultaneously timelimited and bandlimited. 
Hint: Show that contrary assumption leads to contradiction. Assume a signal si- 
multaneously timelimited and bandlimited so that F(w) = 0 for |w| > 27B. In this 
case F(w) = F(w)rect (¢%r) for B' > B. This fact means that f(t) is equal to 
f(t) * 2B’sinc (27B't). The latter cannot be timelimited because the sinc function 


tail extends to infinity. 


2-1 For a signal f(t) that is timelimited to 10 ms and has an essential bandwidth of 10 
kHz, determine No, the number of signal samples necessary to compute a power of 
2-FFT with a frequency resolution F, of at least 50 Hz. Explain if any zero padding 
is necessary. 


Fig. P5.2-2 


2-2 To compute the DFT of signal f(t) in Fig. P5.2-2, write the sequence fr (for k = 0 to 
No — 1) if the frequency resolution Fo must be at least 0.25 Hz. Assume the essential 
bandwidth (the folding frequency) of f(t) to be at least 3 Hz. Do not compute the 
DFT; just write the appropriate sequence fr- 


2-3 Choose appropriate values for No and T and compute the DFT of the signal e~*u(t). 
Use two different criteria for determining the effective bandwidth of e~*u(t). Use the 
bandwidth to be that frequency where the amplitude response drops to 1% of its peak 
value (at w = 0). Next, use the 99% energy criterion for determining the bandwidth 
(see Example 4.16). 


.2-4 Repeat Problem 5.2-3 for the signal 


Oza 
Hint: gig = 2ne7'! 
i f(t) ee) 44 
(a) (b) 
0 1 t> 1 2 t> 
Fig. P5.2-5 


.2-5 For the signals f(t) and g(t) resented in Fig. P5.2-5, write the appropriate sequences 
fh and gz necessary for the computation of the convolution of f(t) and g(t) using 
DFT. Use T = $. 


Continuous-Time System Analysis 
Using the Laplace Transform 


The Fourier transform is a tool which allows us to represent a signal f(t) as a 
continuous sum of exponentials of the form e?”*, whose frequencies are restricted to 
the imaginary axis in the complex plane (s = jw). As we saw in Chapters 4 and 5, 
such a representation is quite valuable in the analysis and processing of signals. In 
the area of system analysis, however, the use of Fourier transform leaves much to 
be desired. First, the Fourier transform exists only for a restricted class of signals 
and, therefore, cannot be used for such inputs as growing exponentials. Second, 
the Fourier transform cannot be used easily to analyze unstable or even marginally 
stable systems. 


6.1 The Laplace Transform 


The basic reason for both these difficulties is that for some signals, such as 
e*tu(t) (a > 0), the Fourier transform does not exist because ordinary sinusoids or 
exponentials of the form e*t (on account of their constant amplitudes) are incapable 
of synthesizing exponentially growing signals. This problem could be resolved if it 
were possible to use basis signals of the form e” (instead of eJ“t), where the complex 
frequency s is not restricted to just the imaginary axis (as in the Fourier transform). 
This is precisely what is done in the following extended transform known as the 
bilateral Laplace transform, where the frequency variable s = jw is generalized 
tos =o+jw. Such generalization permits us to use exponentially growing sinusoids 
to synthesize a signal f(t). Before developing the mathematical operations required 
for such an extension, we will find it illuminating to have an intuitive understanding 
of such a generalization. 


6.1-1 Intuitive Understanding of the Laplace Transform 


If a signal f(t) shown in Fig. 6.1d is not Fourier transformable, we may be 
able to make it Fourier transformable by multiplying it with a decaying exponential 
such as e~°'.tFor example, a signal e?¢u(t) can be made Fourier transformable by 
multiplying it with e77% with ø > 2. Let 


{This assumes that |f(t)| < Me% for some real, positive, and finite numbers M and a. Such 
signals are called exponential-order signals. Signals which do not satisfy this condition may not 
be Laplace transformable. 
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e(t) = f(t) 


as depicted in Fig. 6.la. The signal (t) is now Fourier transformable and its Fourier 
components are of the form et with frequencies w varying from w = —oo to oo. 
The exponential components e/“* and e~3“* in the spectrum add to give a sinusoid 
of frequency w. The spectrum contains an infinite number of such sinusoids, each 
having an infinitesimal amplitude. It would be very confusing to draw all these 
components; hence, in Fig. 6.1b, we show just two typical components. Addition 
of all such components (infinite in number) results in $(t), illustrated in Fig. 6.1a. 
The exponential spectral components of ¢(t) are of the form e»t with complex 
frequencies jw lying on the imaginary axis from w = —o0o to oo, as shown in Fig. 
6.1c. 

Figure 6.la shows a signal ¢(t) = f(t)e~°', Fig. 6.1b shows two of its infinite 
spectral components, and Fig. 6.1c shows the location in the complex plane of the 
frequencies of all the spectral components of ¢(t). Now, the desired signal f(t) can 
be obtained by multiplying ¢(t) with et. This fact means that we can synthesize 
f(t) by multiplying each spectral component of ¢(t) with e°% and adding them. But 
multiplying the spectral components of (t) (sinusoids in Fig. 6.1b) with e7* results 
in the exponentially growing sinusoids as shown in Fig. 6.le. Addition of all such 
exponentially growing sinusoids (infinite in number) results in f(t) in Fig. 6.1d. 
The spectral components of ¢(t) are of the form e4”*. Multiplication of these com- 
ponents with e’ results in the spectral components of the form e’teJ** = el tiv), 
Therefore, a component of frequency jw in the spectrum of ¢(t) is transformed into 
a component of frequency o + jw in the spectrum of f(t). The location in the 
complex plane of the frequencies o + jw is along a vertical line, depicted in Fig. 
6.1f. 

It is clear that a signal f(t) can be synthesized with growing everlasting expo- 
nentials lying along the path o + jw, with w varying from —oo to oo. The value 
of ø is flexible. For example, if f(t) = e?'u(t), then ¢(t) = f(t)e~% can be made 
Fourier transformable if we choose o > 2. Thus, there are infinite choices for ø. 
This means the spectrum of f(t) is not unique, and there are infinite possible ways 
of synthesizing f(t). Nevertheless, o has a certain minimum value go for a given 
f(t) [oo = 2 for f(t) = e7*u(t)]. The region in the complex plane where o > oo 
(Fig. 6.1g) is called the region of convergence (or existence) of the resulting 
transform of f(t). 

All these conclusions reached here by pure heuristic reasoning will now be 
derived analytically. The frequency jw in the Fourier transform will be generalized 
tos=o-+jw. 


6.1-2 Analytical Development of the Bilateral Laplace Transform 
Because we are unifying the Fourier and Laplace transforms, we need to use 


here the unified notation F(jw) instead of F (w) for the Fourier transform, which is 
given by 


F(jw) = T f(t)e”* dt (6.1) 
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fo 


ot) =f He" 


to 
(a) (d) 
t ——> 
(b) (e) 
t t s-plane 
Im 6 + joo 
(ja) 


(f) 


Region of 
convergence 


(g) 


Fig. 6.1 Heuristic explanation of extension of the Fourier transform to Laplace transform. 
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and 5 
fia / F (jwet dw (6.2) 
2r J_oo 
Consider now the Fourier transform of f(t)e7%* (o real) 
Flf(t)e7"'] = / f(t)e te 1" at (6.3) 
-0 
o0 > 
= i. f(t)e~ ots) dt (6.4) 


It follows from Eq. (6.1) that the above integral is F(o + jw). Thus 
Ff (t)e“*'] = F(o + jw) (6.5) 


The inverse Fourier transform of the above equation yields 
L fF ; 
f(t)e"% = zl F (o + jw)ei** dw (6.6) 
2r Joo 
Multiplying both sides with e%t yields 
L f°? ; 
f(t)= z Flo + jwe ti) dw (6.7) 
27 J2 


The quantity (¢ + jw) is the complex frequency s. We now change the variable 
in this integral from w to s. Because s = o + jw, dw = (1/j)ds. The limits of 
integration from w = —o0 to œo now become from (ø — joo) to (a + joo) for the 
variable s. Recall, however, that for a given f(t) , o has a certain minimum value 
co, and we can select any value of o > oo. In general, we can let the limits of 
integration range from s = c — joo to s = ¢ + joo, where c > ao. Thus, Eq. (6.7) 
becomes f 
1 c+joo 
6) = — | F(s)e*' ds (6.8) 
2rj c=joo 


From Eqs. (6.4) and (6.5), we obtain 
F(s) = / f(t)e~* dt (6.8b) 


This pair of equations is known as the bilateral Laplace transform pair (or the 
two-sided Laplace transform pair). The bilateral Laplace transform will be 
denoted symbolically as 


F(s)=L[f(t)] and f(t) = £7"[F(s)] 
or simply as 


f(t) = F(s) 


6.1 The Laplace Transform 365 


Response of LTIC Systems 


Equation (6.8a) expresses f(t) as a weighted sum of exponentials of the form 
e%, This point becomes clear when we write the integral in Eq. (6.8a) as a sum 


1 c+joo 
Fe => f F(s)e* ds 
2rj j 
A [F(nAs)As 
= lim [Zeas] man (6.9) 
TI 


Clearly, the Laplace transform expresses f(t) as a sum of everlasting exponentials 
of the form e("49)* along the path c — joo to c + joo with c > oo. These are 
exponentially growing (if c > 0) or decaying (if c < 0) sinusoids. We can readily 
determine an LTIC system response to the input f(t) by observing that if the system 
transfer function is H(s), then, as demonstrated in Eq. (2.47), the system response 
to the (everlasting) exponential e("4*)' is H (nAs)e("4*)t. From Eq. (6.9), it follows 
that the system response to the input f(t) is 


= tim O [F@AS)H@AS)AS] (nase 
s(t) = lim D [Pace nenelts : 


i 2rj 

1 c'+joo A 
= — F(s)H (s)e™ ds 6.10 
za Jn POH) (6.10) 


The path of integration (from c’ — joo to c’ + joo) in Eq. (6.10) may be different 
from that in Eq. (6.9) to allow for the convergence of the integral in Eq. (6.10). This 
subtle point will be discussed later in Sec. 6.8-1. If y(t) <=> Y (s), then according 
to Eq. (6.10) it follows that 


Y(s) = F(s)H(s) (6.11) 


Here, we have expressed the input f(t) as a sum of exponentials components of 
the form e*t. The system response is then obtained by adding the responses to all 
these exponential components. The procedure followed here is identical to that in 
chapter 2 (where the input is expressed as a sum of impulses) or chapter 4 (where 
the input is expressed as a sum of exponentials of the form e*t), 

In conclusion, we have shown that for an LTIC system with transfer function 
H (s), if the input and the output are f(t) and y(t), respectively, and if 


f(t) = F(s), yt) = ¥(s) 
then 
Y (s) = F(s)H(s) (6.12) 


We shall derive this result more formally later. 


Linearity of the Laplace Transform 
The Laplace transform is a linear operator, and the principle of superposition 
applies; that is, if 


fi(t) => Fy(s) and falt) => Fo(s) 
then 


a; fi(t) + az2f2(t) <=> a1F1(s) + a2F2(8) (6.13) 
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The proof is trivial and follows directly from the definition of the Laplace transform. 
This result can be extended to any finite number of terms. 


The Region of Convergence 


Earlier, we discussed the intuitive meaning of the region of convergence (or 
region of existence) of the Laplace transform F(s). Mathematically, the region of 
convergence for F(s) is the set of values of s (the region in the complex plane) 
for which the integral in Eq. (6.8b) defining the direct Laplace transform F(s) 
converges. This concept will become clear in the following example. 


E Example 6.1 

For the signal f(t) = e~°*u(t), find the Laplace transform F(s) and its region of 
convergence. 

By definition 


F(s)= J e “*u(t)e* dt 


-00 


Because u(t) = 0 for t < 0 and u(t) = 1 for t > 0, 


o0 oo 1 fo =] 
F(s)= J ete dt = J e tale dt = — —— eltolt (6.14) 
0 0 sta o 


Note that s is complex and as t + oo, the term e~¢+2)¢ 


we recall that for a complex number z = a + jf, 


does not necessarily vanish. Here 


-zt = e~ (2tib)t = ete It 


e 
Now |e~/4| = 1 regardless of the value of Gt. Therefore, as t + 00, e-** — 0 only if 
a > 0, and e~** — œ if a < 0. Thus 
0 Re z>0 
lim e7** = (6.15) 
ao œœ Re z<0 
Clearly 
ia padel Re(s+a)>0 
Haoa oo Re(s +a) <0 
Use of this result in Eq. (6.14) yields 
1 
= R >0 6.16a 
F(s) rare e(s+a) ( ) 
or 
eult) <> a Res > -a (6.16b) 
s+a 


The region of convergence of F(s) is Re s > —a, as shown in the shaded area in Fig. 6.2a. 
This fact means that the integral defining F(s) in Eq. (6.14) exists only for the values of 
s in the shaded region in Fig. 6.2a. For other values of s, the integral in Eq. (6.14) does 
not converge. For this reason the shaded region is called the region of convergence (or the 
region of existence) for F(s). 

Recall that the Fourier transform of e~°*u(t) does not exist for negative values of a. 
In contrast, the Laplace transform exists for all values of a, and its region of convergence 
is to the right of the line Re s = ~a. E 


—at 


6.1 The Laplace Transform 367 


e“ u(t) 


t —— 


(a) 


-e u (-t) (b) 


Fig. 6.2 Signals e~°tu(t) and —e**u(—t) have the same Laplace transform but different 
regions of convergence. 


Role of the Region of Convergence 


The region of convergence is required for evaluating the inverse Laplace trans- 
form f(t) from F(s) as defined by Eq. (6.8a). The operation of finding the inverse 
transform requires an integration in the complex plane, which needs some expla- 
nation. The path of integration is along c + jw, with w varying from —oo to oo. 
Moreover, the path of integration must lie in the region of convergence (or existence) 
for F(s). For the signal e~*u(t), this is possible if c > —a. One possible path of 
integration is shown (dotted) in Fig. 6.2a. Thus, to obtain f(t) from F(s), the 
integration in (6.8a) is performed along this path. When we integrate [1/(s + a)]e*? 
along this path, the result is e~°tu(t). Such integration in the complex plane re- 
quires a background in the theory of functions of complex variables. We can avoid 
this integration by compiling a table of Laplace transforms (Table 6.1), where the 
Laplace transform pairs are tabulated for a variety of signals. To find the inverse 
Laplace transform of say, 1/(s +a), instead of using the complex integral (6.8a), we 
look up the table and find the inverse Laplace transform to be e~°u(t). Although 
the table given here is rather short, it comprises the functions of most practical 
interest. A more comprehensive table appears in Doetsch.! 


The Unilateral Laplace Transform 


In order to understand the need for defining a unilateral transform, let us find 
the Laplace transform of signal f(t) illustrated in Fig. 6.2b 


f(t) = -e7*u(—t) 


The Laplace transform of this signal is 


F(s)= 2 —e~**u(—t)e~* dt 


—oo 
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Because u(—t) = 1 for ¢ < 0 and u(—t) = 0 fort > 0, 


0 0 i 0 
F(s)= 7 me tet dt = -f e (Sta) dt = en (sta)t 
-œ s+a 


~oo -= 


Equation (6.15) shows that 


: lim ete)" =0 Re(s+a)<0 
Hence 


1 
F(s) = s+a 


The signal —e~®u(—t) and its region of convergence (Re s < —a) are depicted in 
Fig. 6.2b. Note that the Laplace transforms for the signals e~°'u(t) and —e~*u(—t) 
are identical except for their regions of convergence. Therefore, for a given F(s), 
there may be more than one inverse transform, depending on the region of conver- 
gence. In other words, there is no one-to-one correspondence between F (s) and f (t), 
unless the region of convergence is specified. This fact increases the complexity in 
using the Laplace transform. The complexity is the result of trying to handle causal 
as well as noncausal signals. If we restrict all our signals to the causal type, such an 
ambiguity does not arise. There is only one inverse transform of F(s) = 1 /(s +a), 
namely, e~*u(t). To find f(t) from F(s), we need not even specify the region of 
convergence. In summary, if all signals are restricted to the causal type, then, for a 
given F(s), there is only one inverse transform f(t).f 

The unilateral Laplace transform is a special case of the bilateral Laplace trans- 
form, where all signals are restricted to being causal; consequently the limits of 
integration for the integral in Eq. (6.8b) can be taken from 0 to oo. Therefore, the 
unilateral Laplace transform F(s) of a signal f(t) is defined as 


Res < -a (6.17) 


Loe) 
F(s) = f(t)e~* dt (6.18) 

o- 
We choose 07 (rather than 0* used in some texts) as the lower limit of integration. 
This convention not only ensures inclusion of an impulse function at t = 0, but 
also allows us to use initial conditions at 07 (rather than at O+) in the solution 
of differential equations via the Laplace transform. In practice, we are likely to 
know the initial conditions before the input is applied (at 07), not after the input 

is applied (at 0t). Other advantages of this convention appear on p. 392. 

The unilateral Laplace transform simplifies the system analysis problem con- 
siderably, but the price for this simplification is that we cannot analyze noncausal 
systems or use noncausal inputs. However, in most practical problems this is of 
little consequence. For this reason, we shall first consider the unilateral Laplace 
transform and its application to system analysis. (The bilateral Laplace transform 
is discussed later in Sec. 6.8.) 

Observe that basically there is no difference between the unilateral and the 
bilateral Laplace transform. The unilateral transform is the bilateral transform 
that deals with a subclass of signals starting at t = 0 (causal signals). Therefore, 
the expression [(Eq. (6.8a)] for the inverse Laplace transform remains unchanged. 
In practice, the term Laplace transform means the unilateral Laplace transform. 


t+Actually, F(s} specifies f(t) within a null function n(t) which has the property that the area 
under |n(t)|? is zero over any finite interval 0 to t (t > 0) (Lerch’s theorem). For example, if two 
functions are identical everywhere except at points of discontinuity, they differ by a null function. 
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Existence of the Laplace Transform 


The variable s in the Laplace transform is complex in general, and it can be 
expressed as s = g + jw. By definition 


F(s)= a f(t)e** dt 


= a HOC eI" dt 


Because |e7”*| = 1, the integral on the right-hand side of this equation converges if 
oO 
i |f(t)e~**| dt < 00 (6.19) 
p 


Hence the existence of the Laplace transform is guaranteed if the integral in (6.19) 
is finite for some value of ø. Any signal that grows no faster than an exponential 
signal Me%°* for some M and go satisfies the condition (6.19). Thus, if for some M 
and 00, 


\f(t)| < Me™ (6.20) 


we can choose ø > go to satisfy (6.19).t The signal e? , in contrast, grows at a rate 
faster than e7°*, and consequently e? is not Laplace transformable. Fortunately 
such signals (which are not Laplace transformable) are of little consequence from 
either a practical or a theoretical viewpoint. If øo is the smallest value of ø for 
which the integral in (6.19) is finite, oo is called the abscissa of convergence and 
the region of convergence of F(s) is Re s > og. The abscissa of convergence for 
e~*tu(t) is —a (the region of convergence is Re s > —a). 


E Example 6.2 
Determine the Laplace transform of (a) 6(t) (b) u(t) (c) cos wot u(t). 
(a) eo 
L [6t] = i d(t)e** dt 
o= 


Using the sampling property {Eq. (1.24a)], we obtain 


£[6(t)] =1 for all s 
that is 


ót) == 1 for all s (6.21) 
(b) To find the Laplace transform of u(t), recall that u(t) = 1 for t > 0. Therefore 


£[u(t)] = f. u(t)e dt = I edt =- let 7 
0 


= 8 o- 


ae Res>0 (6.22) 
{Condition (6.20) is sufficient but not necessary for the existence of the Laplace transform. For 
example f(t) = 1/V4 is infinite at t = 0 and, (6.20) cannot be satisfied, but the transform of 1/ vt 
exists and is given by ,/7/s. 
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F(t) FAC) 


(a) (b) 
Fig. 6.3 Signals for Exercise E6.1. 


We also could have obtained this result from (6.16b) by letting a = 0. 


(c) Because 
cos wot u(t) = 3 [e%* + 9°") u(t) (6.23) 


L [cos wot u(t)] = 3 £ [e7 ot u(t) + e Ffu(z)] 


From Eq. (6.16), it follows that 


1 z 
£ feos wot u(t) = 3 | 1 + Re (s + jw) = Res > 0 


2/s-—jwo s+ jwo 
s 
Soen 0 6.24 
Aro Res > (6.24) 
E 


For the unilateral Laplace transform, there is a unique inverse transform of 
F (s); consequently, there is no need to specify the region of convergence explicitly. 
For this reason, we shall generally ignore any mention of the region of convergence 
for unilateral transforms. Recall, also, that in the unilateral Laplace transform it is 
understood that every signal f(t) is zero for t < 0, and it is appropriate to indicate 
this fact by multiplying the signal by u(t). 
A Exercise E6.1 


By direct integration, find the Laplace transform F(s) and the region of convergence of F(s) 
for the signals shown in Fig. 6.3. 


Answer: (a) 3(1~e~?*) for alls. (b) 2(1—e7%*)e-28 for alls. y 


Connection to the Fourier Transform 


The definition of the Laplace transform is identical to that of the Fourier trans- 
form with jw replaced by s. It is reasonable to expect F(s), the Laplace transform 
of f(t), to be the same as F(w), the Fourier transform of f(t) with jw replaced by 
s. For example, we found the Fourier transform of e~*u(t) to be 1/(jw + a). Re- 
placing jw with s in the Fourier transform results in 1/(s +a), which is the Laplace 
transform as seen from Eq. (6.16b). Unfortunately this procedure is not valid for 
all f(t). We may use it only if the region of convergence for F(s) includes the 
imaginary (jw) axis. For instance, the Fourier transform of the unit step function 
is nê(w) + (1/jw). The corresponding Laplace transform is 1/s, and its region of 
convergence, which is Re s > 0, does not include the imaginary axis. In this case the 
connection between the Fourier and Laplace transforms is not so simple. The reason 
for this complication is related to the convergence of the Fourier integral, where the 
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path of integration is restricted to the imaginary axis. Because of this restriction, 
the Fourier integral for the step function does not converge in the ordinary sense 
as Example 4.7 demonstrates. We had to use a generalized function (impulse) for 
convergence. The Laplace integral for u(t), in contrast, converges in the ordinary 
sense, but only for Re s > 0, a region forbidden to the Fourier transform. Another 
interesting fact is that although the Laplace transform is a generalization of the 
Fourier transform, there are signals (e.g., periodic signals) for which the Laplace 
transform does not exist, although the Fourier transform exists (but not in the 
ordinary sense). 


6.1-3 Finding the Inverse Transform 


Finding the inverse Laplace transform by using the definition (6.8a) requires 
integration in the complex plane, a subject beyond the scope of this book.2 For our 
purpose, we can find the inverse transforms from the transform table 6.1. All we 
need is to express F(s) as a sum of simpler functions of the form listed in the table. 
Most of the transforms F(s) of practical interest are rational functions; that is, 
ratios of polynomials in s. Such functions can be expressed as a sum of simpler 
functions by using partial fraction expansion (see Sec. B.5). Values of s for which 
F(s) = 0 are called the zeros of F(s); the values of s for which F(s) = œ are 
called the poles of F(s). If F(s) is a rational function of the form P(s)/Q(s), the 
roots of P(s) are the zeros and the roots of Q (s) are the poles of F(s). 


E Example 6.3 
Find the inverse Laplace transforms of 


1s —6 2s? +5 6(s + 34) 8s +10 
(a) s- s-6 (b) s? +3s +2 (c) s(s? + 10s + 34) (a) (s +1)(s + 2)8 


The inverse transform of none of the above functions is directly available in Table 
6.1. We need to expand these functions into partial fractions discussed in Sec. B.5. 
(a) 
7s —6 


8) = Gy aVe—3) 


To determine k;, corresponding to the term (s+ 2), we cover up (conceal) the term (s + 2) 
in F(s) and substitute s = —2 (the value of s that makes s + 2 = 0) in the remaining 
expression (see Sec. B.5-2) 

7s —6 


°* a 


Similarly, to determine kz corresponding to the term (s — 3), we cover up the term (s — 3) 
in F(s) and substitute s = 3 in the remaining expression 


-14-6 
= 73 7t 


s=-2 


7s — 6 21—6 
k2 = = =3 
(s + 2) og 3+2 
Therefore 
Ts— 6 4 3 
BOYS Grge- ia 328 ous) 
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Table 6.1 


A Short Table of (Unilateral) Laplace Transforms 
a 


f(t) F(s) 
1 6(t) 1 
1 
2 u(t) F 
1 
3 tu(t) 8? 
n! 
4 t? u(t) nti 
1 
5 etu(t) SN 
1 
6 te**u(t) (s— d)? 
n! 
7 t™etu(t) (s— Arti 
8 
8a cos bt u(t) s2402 
b 
8b sin bt u(t) +e 
sta 
9a ee ** cos bt u(t) (sta)? +o 
b 
9b et sin bt u(t) (s + a)? + b2 


(r cos 6)s + (ar cos @ — br sin 8) 


10a re~** cos (bt + 6) u(t) 3? + Das + (a? + b?) 


0.5re?? 0.5re77? 


10b re~* cos (bt + 0) u(t) s+a—jb s+a+jb 


As+B 
10c re~* cos (bt + 0) u(t) RESET. 
es APctB?—24Be, 6 = tan`! inthe 
b=Vc-a 
— Aa . As+B 
10d e7% [4 cos bt + sin g u(t) REET 


b= Ve- a? 
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Checking the answer 


It is easy to make a mistake in partial fraction computations. Fortunately it is 
simple to check the answer by recognizing that F(s) and its partial fractions must 
be equal for every value of if the partial fractions are correct. Let us verify this 


assertion in Eq. (6.25a) for some convenient value, say s = 1. Substitution of s = 1 
in Eq. (6.25a) yields} 


Se oe 
6 3 2 6 
We can now be sure of our answer with a high margin of confidence. Using Pair 5 


(Table 6.1) in Eq. (6.25a), we obtain 


ft) =c ( ee 2 3) = (4e7* + 35) u(t) (6.25b) 


(b) 
F(s) = 2s? +5 _ 2s? +5 
BUS s7+3s+2 (s+1)(s +2) 
Observe that F(s) is an improper function with m = n. In such a case we can 
express F(s) as a sum of the coefficient bn (the coefficient of the highest power in 
the numerator) plus partial fractions corresponding to the poles of F(s) (see Sec. 
B.5-4). In the present case b, = 2. Therefore 


ki ko 
F(s)=2 — 
HEE a 
where 
and 
Therefore 
F(s)=2+ 7T B 
ao s+1 8s+2 
From Table 6.1, Pairs 1 and 5, we obtain 
f(t) = 26(t) + (7e~* — 13e7**) u(t) (6.26) 
(c) 
6(s + 34) 
PMY s(s? + 10s + 34) 
z 6(s + 34) 
~ s(s +5- j3)(s +5 +53) 
_ ki k2 k2* 


s T345- j3 a See 


{Because F(s) = co at its poles, we should avoid the pole values (—2 and 3 in the present case) 
for checking. It is possible that the answers may check even if partial fractions are wrong. This 
situation can occur when two or more errors cancel their effects. But the chances of this problem 
arising for randomly selected values of s are extremely small. 
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Note that the coefficients (k2 and ka") of the conjugate terms must also be conjugate 
(see Sec. B.5). Now 


a <_ Ble +34) _6xH 
1 G(s? + 10s +34)| o 34 
ha 6(s + 34) = tI ee 
(s +5+33)ls=-5+4;3 -3-45 
Therefore 
k2* = -3 — j4 


To use Pair 10b (Table 6.1), we need to express kz and kọ* in polar form. 


-3+ jå = (VIF 4) eftam 4/9) = Bed tn: (4/-3) 


Observe that tan™i (4) £ tan™!(—4). This fact is evident in Fig. 6.4. Remember 
that electronic calculators can give answers only for the angles in the first and the 
fourth quadrant. For this reason it is important to plot the point (e.g. -3 + j4) 
in the complex plane, as depicted in Fig. 6.4, and determine the angle. For further 
discussion of this topic, see Example B.1. 

From Fig. 6.4, we observe that 


ko = —3 + j4 = 5e176.9° 


so that aa 
ko" = Be 1126.9 


fore 
Therefo 6 5ej126-9° 5e—3126.9° 


A anh Ce ET awe IT 
From Table 6.1 (Pairs 2 and 10b), we obtain 


f(t) = [6 + 10e~* cos (3t + 126.9°)} u(t) (6.27) 


Fig. 6.4 tan`? (3) # tan! (5) 
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Alternative Method Using Quadratic Factors 


The above procedure involves considerable manipulation of complex numbers. As 


indicated by Pair 10c (Table 6.1), the inverse transform of quadratic terms (with complex * 


conjugate poles) can be found directly without having to find first-order partial fractions. 
We now show the alternative method (also discussed in Sec. B.5-2), which uses this obser- 
vation. For this purpose we shall express F(s) as 


6(s + 34) ky As+B 
igjaa ee Oy 
Orrin e t alee a 


We have already determined that kı = 6 by the (Heaviside) “cover-up” method. Therefore 


6(s + 34) 6 As+B 


s(s?+10s+34) s s?+10s+34 
Clearing the fractions by multiplying both sides by s(s? + 10s + 34) yields 
6(s + 34) = 6 (8? + 10s + 34) + s(As + B) 
= (6+ A)s? + (60+ B)s + 204 
Now, equating the coefficients of s? and s on both sides yields 


0=(6+A) = A=-6 


6=60+B => B= -54 
and 
—6s — 54 
s2 + 10s + 34 


We now use Pairs 2 and 10c to find the inverse Laplace transform. The parameters for 
Pair 10c are A = —6, B = —54, a = 5, c = 34, and b = Vc — a? = 3, and 


F(s)= 24 


= A?c+B?~-2ABa _ _ -1l _Aa-B _ o 
r= y4 Ma 10, 6 =tan Amat = 126.9 
Therefore 
f(t) = [6 + 10e~** cos (3t + 126.9°)]u(E) 


which agrees with the previous result. 


Short-Cuts 


The partial fractions with quadratic terms also can be obtained by using short cuts. 


We have 
6(s + 34) 6 As+B 


F(s) = ——————- = - + aM 
(9) = [at 410s434) ~ st 2410s +34 
We can determine A by eliminating B on the right-hand side. This step can be accom- 
plished by multiplying both sides of the above equation by s and then letting s — oo. 
This procedure yields 
0=6+A = A=-6 
Therefore 
6(s + 34) _6 ~s + B 
s(s? + 10s +34) s ` s2+10s +34 


To find B, we let s take on any convenient value, say s = 1, in this equation to obtain 
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45 7 45 
Multiplying both sides of this equation by 45 yields 
210 = 270 + B -6 => B = —54 
a deduction which agrees with the results we found earlier. 
(d) 


8s + 10 


F(s) = Gye +a 


ky ao ay a2 
Se E E E E E 
sFI G42) (42)? 342 


where (see Sec. B.5-2) 


8s +10 
k= 2 
Ges + 2)°|,_ 
” 8s +10 6 
o= = 
(s + 1) by 


8s +10 =-2 
G+) pany 


ds 
c -2 
ra G+) a a 


Gl 


Therefore a 9 x 6 7 2 2 
ee Gros Gra? st 
and 


f(t) = [2e~* + (3t? — 2t — 2)e™™] u(t) (6.28) 


Alternative Method: A Hybrid of Heaviside and Clearing Fractions 


In this method, the simpler coefficients kı and ao are determined by the Heaviside 
“cover-up” procedure, as discussed earlier. To determine the remaining coefficients, we 
use the clearing-fraction method (see Sec. B.5-3). Using the values kı = 2 and ao = 6 
obtained earlier by the Heaviside “cover-up” method, we have 


8s +10 2 6 ai a2 


(FG +I! StI GEI t G+ s+ 
We now clear fractions by multiplying both sides of the equation by (s + 1)(s + 2)?. This 
procedure yieldst 
83 + 10 = 2(s + 2)? + 6(s + 1) + ar(s + 1)(s + 2) + a2(s + 1)(8 + 2)? 
= (2 + a2)s? + (12 + a1 + 5a2)8? + (30 + 3a1 + 8a2)s + (22 + 2a1 + 4a2) 


+We could have cleared fractions without finding kı and ag. This alternative, however, proves 
more laborious because it increases the number of unknowns to 4. By predetermining kı and ao, 
we reduce the unknowns to 2. Moreover, this method provides a convenient check on the solution. 
This hybrid procedure achieves the best of both methods. 
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Equating coefficients of s? and s? on both sides, we obtain 


O=(2+a2) = a2=-2 
0=12+a:+5a2=2+01 = a, = -2 
We can stop here if we wish, since the two desired coefficients a1 and a2 have already been 


found. However, equating the coefficients of s! and s? serves as a check on our answers. 
This step yields 


8 = 30 + 3a1 + 8a2 
10 = 22 + 2a; + 4a2 


Substitution of a1 = az = —2, obtained earlier, satisfies these equations. This step assures 
the correctness of our answers. 


Another Alternative: A Hybrid of Heaviside and Short-Cuts 


In this method, the simpler coefficients kı and ag are determined by the Heaviside 

“cover-up” procedure, as discussed earlier. The usual short-cuts are then used to determine 

the remaining coefficients. Using the values kı = 2 and ao = 6, determined earlier by the 
Heaviside method, we have 


8s + 10 _ 2 + 6 P ai + a2 
(s+1)(s+2)3 s+1 ` (s+2)3 ` (s+2)2 "s+2 


There are two unknowns, a; and az. If we multiply both sides by s and then let s > o0, 
we eliminate a1. This procedure yields 


0=2+a2 => a=-2 
Therefore 
8s + 10 27 2 6 “o 2 
GFDG+2 shit (s+ 2)3 + Gaya s+2 
There is now only one unknown, a. This value can be determined readily by setting s 
equal to any convenient value, say s = 0. This step yields 


© Computer Example C6.1 
Find the inverse laplace transform of the following functions using partial fraction 
expansion method: 


(a) 287 +5 (b) 28? +75 +4 (o) 8s? + 21s +19 
s? +3s+2 (s + 1)(s + 2)? (s + 2)(s?+s+7) 


(a) 
num=[2 0 5]; den=[1 3 2]; 
[r,p,k]=residue(num,den) 


xr = -13, 7 
pee, ei 
k= 2 
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Thus, 
F(s)=— 34 and f(t) = (-18e-* + Ze“*)ult) + 26(¢) 
s+2 s+l 


(b) 

num=([2 7 4]; den=[(conv(conv((1 1],[1 2]),{1 2])}; 
[r, p, k]= residue(num,den); 

r= 3, 2, -i 

p72, -2, -i 

k= [] 


Hence, F(s) = 2 2 and f(t) = (3e7% + 2te7** — e~*)u(t) 


1 
342° GA 3+1 
(c) 


num=[8 21 19]; den=[conv([0 1 2],[1 1 7])]; 
[r, p, k]= residue(num,den) 
[angle,mag]=cart2pol(real(r),imag(r)) 

r= 3.5 ~ 0.48111, 3.5 + 0.48111, 1.00 

p = -0.5 + 2.59811, -0.5 - 2.59811, -2.00 
k= {J 

angle = -0,1366, 0.1366, 0 

mag = 3.5329, 3.5329, 1.00 


1, 3.5329 e 90-1366 3.5329 270-1866 
s+2 s+0.5— 52.5981  s+0.5+4 52.5981 


Hence, F(s) = 
and 


F (t) = [e7* + 1.766 e°** cos (2.5981t — 0.1366)] u(t) ©) 


© Computer Example C6.2 

Find (a) the direct Laplace transform of sin at + cos bt (b) the inverse Laplace 
transform of (as*)/(s? + b°). 

Here we shall use Symbolic Math Toolbox, which is a collection of functions for 
MATLAB used for manipulating and solving symbolic expressions. 

(a) 

f=sym(’sin(a*t)-+cos(b*t)’); 

F=laplace(f) 

F=(ats*2+b*2*at+s~3+s*a~2)/(s*2+a~2)/(s"2+b72) 


Thus, 
F(s) = s* + as? +075 + ba 
oe? + a2) (s? + 8) 
(b) 


F=sym(’(a*s*2)/(s*2+b*2); 
f=invlaplace(F) 


Fea*dirac(t)-a*b*sin(b+t) 


Thus, 
f(t) = ad(t) + absin(bt)u(t) Ç) 
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A Exercise E6.2 
-14 
(i) Show that the Laplace transform of 10e7%¢ cos (4t + 53.13°) is See Use Pair 


82 + 6s +25° 
10a from Table 6.1. 
ey : ; s+17 3s ~5 
(ii) Find the inverse Laplace transform of: (a) PERPE (b) Hie? +2548) 
16s + 43 


ce) (s — 2)(s + 3)? 
Answers: (a) (3et - 2e75t) u(t) (b) [-2e7t + Še™t cos (2t — 36.87°)] u(t) 
(c) [3e + (t - Be“ ult) y 


A Historical Note: Marquis Pierre-Simon De Laplace (1749-1827) 

The Laplace transform is named after the great French mathematician and 
astronomer Laplace, who first presented the transform and its applications to dif- 
ferential equations in a paper published in 1779. 

Laplace developed the foundations of potential theory and made important 
contributions to special functions, probability theory, astronomy, and celestial me- 
chanics. In his Ezposition du systeme du Monde (1796), Laplace formulated a 
nebular hypothesis of cosmic origin and tried to explain the universe as a pure 
mechanism. In his Traite de Mechanique Celeste (celestial mechanics), which com- 
pleted the work of Newton, Laplace used mathematics and physics to subject the 
solar system and all heavenly bodies to the laws of motion and the principle of 
gravitation. Newton had been unable to explain the irregularities of some heavenly 
bodies; in desperation, he concluded that God himself must intervene now and then 
to prevent some catastrophes, such as Jupiter eventually falling into the sun (and 
the moon into the earth) as predicted by Newton’s calculations. Laplace proposed 
to show that these irregularities would correct themselves periodically, and that a 
little patience—in Jupiter’s case, 929 years—would see everything returning auto- 
matically to order, and there was no reason why the solar and the stellar systems 
could not continue to operate by the laws of Newton and Laplace to the end of 
time. 

Laplace presented a copy of M. echanique Celeste to Napoleon, who, after read- 
ing the book, took Laplace to task for not including God in his scheme: “You have 
written this huge book on the system of the world without once mentioning the au- 
thor of the universe.” “Sire,” Laplace retorted, “I had no need of that hypothesis.” 
Napoleon was not amused, and when he reported this reply to Lagrange, the latter 
remarked, “Ah, but that is a fine hypothesis. It explains so many things.” 4 

Napoleon, following his policy of honoring and promoting scientists, made 
Laplace the minister of the interior. To Napoleon’s dismay, he found the great 
mathematician-astronomer bringing “the spirit of infinitesimals” into administra- 
tion, and so had Laplace transferred hastily to the senate. 


Oliver Heaviside (1850-1925) 

Although Laplace published his transform method to solve differential equa- 
tions in 1779, the method did not catch on until a century later. It was rediscovered 
independently in a rather awkward form by an eccentric British engineer, Oliver 
Heaviside (1850-1925), one of the tragic figures in the history of electrical engi- 
neering. Despite his prolific contributions to electrical engineering, he was severely 
criticized during his lifetime, and was neglected later to the point that hardly a 
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P.S. de Laplace (left) and Oliver Heaviside (right). 


textbook today mentions his name or contributions. With the passage of time, 
Heaviside becomes more distant, although his studies had a major impact on many 
aspects of modern electrical engineering. It was Heaviside who made transatlantic 
communication possible by inventing cable loading, but no one ever mentions him 
as a pioneer or an innovator in telephony. It was Heaviside who suggested the use 
of inductive cable loading, but the credit is given to M. Pupin, who actually built 
the first loading coil. In addition, Heaviside was® 

e The first to find a solution to the distortionless transmission line; 

e The innovator of lowpass filters; 

e The first to write Maxwell’s equations in modern form; 

e The co-discoverer of rate energy transfer by an electromagnetic field; 

e An early champion of the now-common phasor analysis; 

e An important contributor to the development of vector analysis. In fact, he 

essentially created the subject independently of Gibbs®; 

e An originator of the use of operational mathematics used to solve linear 

integro-differential equations, which eventually led to rediscovery of the ignored 

Laplace transform; 

e The first to theorize (along with Kennelly of Harvard) that a conducting layer 

(the Kennelly-Heaviside layer) of atmosphere exists, which allows radio waves 

to follow earth’s curvature instead of traveling off into space in a straight line; 

e The first to posit that an electrical charge would increase in mass as its 

velocity increases; an anticipation of an aspect of Einstein’s special theory of 

relativity.” He also forecast the possibility of superconductivity. 

Heaviside was a self-made, self-educated man with only an elementary school 
education, who eventually became a pragmatically successful mathematical physi- 
cist. He began his career as a telegrapher, but increasing deafness forced him to 
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retire at the age of 24. He then devoted himself to the study of electricity. His 
creative work was disdained by many professional mathematicians because of his 
lack of formal education and his unorthodox methods. 

Heaviside’s misfortune was that he was criticized both by mathematicians, who 
faulted him for lack of rigor, and by men of practice, who faulted him for using too 
much mathematics and thereby confusing students. Many mathematicians, trying 
to find solutions to the distortionless transmission line, failed because no rigorous 
tools were available at the time. Heaviside succeeded because he used mathematics 
not with rigor, but with insight and intuition. Using his much-maligned operational 
method, Heaviside successfully attacked problems that the rigid mathematicians 
could not solve: problems such as the flow of heat in a body of spatially varying 
conductivity. Heaviside brilliantly used this method in 1895 to demonstrate a fatal 
flaw in Lord Kelvin’s determination of the geological age of the earth by secular 
cooling; he used the same flow of heat theory as for his cable analysis. Yet the 
mathematicians of the Royal Society remained unmoved and were not the least 
impressed by the fact that Heaviside had found the answer to problems no one 
else could solve. Many mathematicians who examined his work dismissed it with 
contempt, asserting that his methods were either complete nonsense or a rehash of 
already-known ideas.® 

Sir William Preece, the chief engineer of the British Post Office, a savage critic 
of Heaviside, ridiculed Heaviside’s work as too theoretical and, therefore, leading to 
faulty conclusions. Heaviside’s work on transmission lines and loading was dismissed 
by the British Post Office; this work might have remained hidden, had not Lord 
Kelvin himself publicly expressed admiration for it.5 

Heaviside’s operational calculus may be formally inaccurate, but in fact it antic- 
ipated the current operational methods developed in more recent years.® Although 
his method was not fully understood, it provided correct results. When Heaviside 
was attacked for the vague meaning of his operational calculus, his pragmatic reply 
was, “Shall I refuse my dinner because I do not fully understand the process of 
digestion?” 

Heaviside lived as a bachelor hermit, often in near-squalid conditions, and died 
largely unnoticed, in poverty. His life demonstrates the arrogance and snobbish- 
ness of the intellectual establishment, which does not respect creativity unless it is 
presented in the strict language of the establishment. 


6.2 Some Properties of the Laplace Transform 


Because it is a generalized form of the Fourier transform, we expect the Laplace 
transform to have properties similar to those of the Fourier transform. However, 
we are discussing here mainly the properties of the unilateral Laplace transform, 
and they differ somewhat from those of the Fourier transform (which is a bilateral 
transform). 

Properties of the Laplace transform are useful not only in the derivation of the 
Laplace transform of functions but also in the solutions of linear integro-differential 
equations. A glance at Eqs. (6.8a) and (6.8b) shows that, as in the case of the Fourier 
transform, there is a certain measure of symmetry in going from f(t) to F(s), and 
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vice versa. This symmetry or duality is also carried over to the properties of the 
Laplace transform. This fact will be evident in the following development. 


1. Time Shifting 
This property states that if 


S(t) => F(s) 


then for tp > 0 
f(t — to) => F(s)e" (6.29a) 


Observe that f(t) starts at t = 0, and, therefore, f(t — to) starts at t = tp. This 
fact is implicit, but is not explicitly indicated in Eq. (6.29a). This often leads to 
inadvertent errors. To avoid such a pitfall, we should restate the property as follows: 
If 
fult) = F(s) 
then 
f(t — tojult — to) = F(s)e~** to > 0 (6.29b) 


Proof: 
Elft- tout- to) = f f(t- tojult — toje ™* dt 


Setting t — to = z, we obtain 


L [F(t — to)u(t — to)) = i f(a)u(x)e8@+t0) dz 


Because u(x) = 0 for x < 0 and u(x) = 1 for z > 0, the limits of integration are 
from 0 to oo. Thus 


L [f(t ~ to)u(t — to)] = % f(aje St) dg 


o0 

= a} f(zje—** dx 
0 

= F (s)e7 


Note that f(t — to)u(t — to) is the signal f(t)u(t) delayed by to seconds. The time- 
shifting property states that delaying a signal by tp seconds amounts to multiplying 
its transform e~**. B 

This property of the unilateral Laplace transform holds only for positive to 
because if to were negative, the signal f(t — to)u(t — to) would not be causal. 

We can readily verify this property in Exercise E6.1. If the signal in Fig. 6.3a 
is f(t)u(t), then the signal in Fig. 6.3b is f(t — 2)u(t — 2). The Laplace transform 
for the pulse in Fig. 6.3a is +(1 — e~?*). Therefore, the Laplace transform for the 
pulse in Fig. 6.3b is (1 — e~?*)e~?*, 
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Fig. 6.5 Finding a mathematical description of a function F(t) in Fig. 6.5a. 


The time-shifting property proves very convenient in finding the Laplace 
transform of functions with different descriptions over different intervals, as the 
following example demonstrates. 


a Example 6.4 

Find the Laplace transform of f(t) depicted in Fig. 6.5a. 

Describing mathematically a function such as the one in Fig. 6.5a is discussed in Sec. 
1.4, The function f(t) in Fig. 6.5a can be described as a sum of two components shown 
in Fig. 6.5b. The equation for the first component is t — 1 over 1 < t < 2, so that this 
part of f(t) can be described by (t — 1)[u(t — 1) -— u(t — 2)]. The second component can 
be described by u(t — 2) — u(t — 4). Therefore 


F(t) = (t = 1) [u(t — 1) — u(t - 2)) + fult - 2) - u(t — 4)] 
= (t — 1ju(t — 1) - (t - 1)u(t — 2) + u(t — 2) - u(t — 4) (6.30a) 
The first term on the right-hand side is the signal tu(t) delayed by 1 second. Also, the 
third and fourth terms are the signal u(t) delayed by 2 and 4 seconds respectively. The 


second term, however, cannot be interpreted as a delayed version of any entry in Table 
6.1. For this reason, we rearrange it as 


(t — 1)u(t — 2) = (t -2 + 1)u(t — 2) = (t — 2)u(t — 2) + u(t — 2) 


We have now expressed the second term in the desired form as tu(t) delayed by 2 seconds 
plus u(t) delayed by 2 seconds. With this result, Eq. (6.30a) can be expressed as 


f(t) = (t — 1)u(t — 1) — (t — 2)u(t — 2) — u(t — 4) (6.30b) 


Application of the time-shifting property to tu(t) <=> 1/3? yields 


Le de 
(t — l)u(t-1) => ue and (t— 2)u(t—- 2) ==> ze ka 


Also i i 
u(t) = = and u(t- 4) => ze“ (6.31) 
Therefore í ; i 
a —2. —48 
F(s) = ze $- ze s- 3 (6.32) 
E 
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f(t) 
2 
0 1 2 3 t— 


Fig. 6.6 The signal for Exercise E6.3. 


E Example 6.5 
Find the inverse Laplace transform of 


s+3+5e%9 
(s+ 1)(s +2) 


Observe the exponential term e~*° in the numerator of F(s), indicating time-delay. In 
such a case we should separate F(s) into terms with and without delay factor, as 


F(s) = 


2s 


23 
FO) = GEGTT* GND 
Fi (8) F2(s)e~?* 
where $43 2 1 
RO= GEDEFI s+i Fe 
OTE COREEI 
Therefore 


filt) = (2e7* — e™™) u(t) 
falt) = 5 (e7* — e™™) u(t) 


Also, because Sas 
F(s) = Fi(s) + Fa(s)e 


f(t) = falt) + fa(t — 2) 
= (2e~* - e-*) u(t) +5 jer = emata) u(t—2) E 


A Exercise E6.3 ; ar 
Find the Laplace transform of the signal illustrated in Fig. 6.6. 


Answer: Za — Be7?5 + 2e-38) y 
S 


A Exercise E6.4 
Find the inverse Laplace transform of 


3e—28 


Fle) = Gayle 2) 


Answer: fet? - gts) ut—2) v 
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2. Frequency Shifting 
This property states that if 


S(t) = F(s) 
then 
f(t)e%? = F(s — so) (6.33) 


Observe the symmetry (or duality) between this property and the time-shifting 
property (6.29a). 


Proof: 
£ HOG = 1 f (tjet te dt = f(t)e 7T) dt = F(s — so) 
0~ o= 


E Example 6.6 


Derive Pair 9a in Table 6.1 from Pair 8a and the frequency-shifting property. 

The Pair 8a is 4 
cos bt u(t) <=> Fae 

From the frequency-shifting property [Eq. (6.33)] with so = —a we obtain 


sta 


~at 
bt eats 
e “cos btu(t) => (tata 


A Exercise E6.5 
Derive Pair 6 in Table 6.1 from Pair 3 and the frequency-shifting property. 7 


We are now ready to consider the two of the most important properties of the 
Laplace transform: the time-differentiation and time-integration properties. 


3. The Time-Differentiation Property} 
This property states that if 


then 
— <> sF(s)— f (07) (6.34a) 
Repeated application of this property yields 

2 


TE e F(s) — sf (07) - j (07) (6.34b) 


{The dual of the time-differentiation property is the frequency-differentiation property, which 
states that 


tft) = -Ż F(s) 
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at <=> s"F(s) — s” (07) — s”? f(07) —-.. — f-D 07) (6.34c) 
t 
where f‘")(0-) is d"f/dt” at t = 07. 
Proof: 


df 25 ° df -st 
aA =f Prii dt 


Integrating by parts, we obtain 


co OO 


+s |] fte dt 
o- 0- 


For the Laplace integral to converge (that is for F(s) to exist), it is necessary that 
f(t)e** — 0 as t — oo for the values of s in the region of convergence for F(s). 


Thus, 


£ BE = =f (07) + sF (s) 


dt 


f) 


(c) 


-3 
Fig. 6.7 Finding the Laplace transform of a piecewise-linear function using the time- 
differentiation property. 
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a Example 6.7 

Find the Laplace transform of the signal f(t) in Fig. 6.7a using Table 6.1 and the 
time-differentiation and time-shifting properties of the Laplace transform. 

Figures 6.7b and 6.8¢ show the first two derivatives of f(t). Recall that the derivative 
at a point of jump discontinuity is an impulse of strength equal to the amount of jump 
[see Eq. (1.27)]. Therefore 


1 


df E FA 
mR” 6(t) — 36(t — 2) + 26(t — 3) 


The Laplace transform of this equation yields 


£ (3) = L [6(t) — 38(t — 2) + 26(t — 3)] 
dt? 


Using the time-differentiation property (6.34b), the time-shifting property (6.29a) and the 
facts that f(07) = f(07) = 0, and (t) <=> 1, we obtain 


s’F(s)~0-0=1—3e-** + 26-3 


Therefore 1 
—2., ~3s 
F(s) = = (1-37 + 2e7*) 


which confirms the earlier result in Exercise E6.3. W 


4. The Time-Integration Property; 
This property states that if 


f(t) => F(s) 
then 
' f(t)dr == 7) (6.35) 
and g 
[sear e EO q Eata (6.36) 


Proof: We define i 
at)= f s(r)ar 
ò= 


so that F 
ait) = F(t) and g(07)=0 


Now, if 
g(t) => G(s) 


et 
tThe dual of the time-integration property is the frequency-integration property, which states that 


19 = [f roe 
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then 3 
F(s)= Fa ) = sG(s) — g(0-) = sG(s) 
Therefore 
F 
s 
or 


t 
a f(r)dr <= El) 


To prove Eq. (6.36), observe that 


f ronf toas f f(r)dr 


Note that the first term on the right-hand side is a constant. Taking the Laplace 
transform of the above equation and using Eq. (6.35), we obtain 


t © f(r) ar 8 
/ gpa aes Ea 


8 


Scaling 
This property states that if 
f(t) <= F(s) 
then for a > 0 i 
8 
fat) = =F (=) (6.37) 


The proof is identical to that of the scaling property of the Fourier transform derived 
in Chapter 4 [Eq. (4.34)]. Note that a is restricted to only positive values because 
if f(t) is causal, then f(at) is anticausal (exists only for t < 0) for negative a, and 
anticausal signals are not permitted in the (unilateral) Laplace transform. 

Recall that f(at) is the signal f(t) time-compressed by the factor a, and F ($) 
is F(s) expanded along the s-scale by the same factor a (see Sec. 1.3-2). The scaling 
property states that time-compression of a signal by a factor a causes expansion of 
its Laplace transform in s-scale by the same factor. Similarly, time-expansion f (t) 
causes compression of F(s) in s-scale by the same factor. 


5. Time Convolution and Frequency Convolution 
This property states that if 


filt) = Fi(s) and fo(t) <=> Fa(s) 


then (time convolution property) 


falt) * falt) = Fi(s)Fo(s) (6.38) 


and (frequency convolution property) 


falt)falt) = 5 [Fi (s) * Fa(s)] (6.39) 


6.2 Some Properties of the Laplace Transform 389 


Table 6.2 
The Laplace Transform Properties 2 
rr 
Operation f(t) F(s) 


=n 


Addition fi (t) + fo(t) Fi (s) + F2(s) 
Scalar multiplication kf (t) kF(s) 
Time differentiatio a 7 
nO sF(s) — f(07) 

df : 

— 3°F(s) = sf(0-) - #(0-) 

a? f 3 2 

zí F(s) - sf (07) — sf (07) - f(0-) 

f 1 
Time integration f(r) dr ~F(s) 
0- s 
t 1 > 
f(r) dr —F(s)+- f(t) dt 
-0 s -o0 
Time shift f(t — toju(t— to) F(s)e~% to>0 
Frequency shift f (t)eSo* F(s — sọ) 
Frequency —tf (t) dEl) 
differentiation s 
Frequency integration o Í i F(z) dz 
Scaling f(at),a>0 lp (=) 
a a 
Time convolution Filt) * falt) Fı(s)F2(8) 
Frequency convolution fı (t) fa(t) fl * Fo(s) 
2rj 

Initial value f(0+) Jim sF(s) (n>m) 
Final value f(œ) lim sF (s) (poles of sF (s) in LHP) 
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Observe the symmetry (or duality) between the two properties. Proofs of these 
properties are similar to the proofs in Chapter 4 for the Fourier transform. 

Equation (2.48) indicates that H(s), the transfer function of an LTIC system, 
is the Laplace transform of the system’s impulse response h(t); that is, 


h(t) = H(s) (6.40) 


We can apply the time convolution property to the LTIC input-output relationship 
y(t) = f(t) * h(t) to obtain 
Y (s) = F(s)H(s) (6.41) 


This exact result appeared earlier in Eq. (6.11). 


E Example 6.8 

Using the time convolution property of the Laplace transform, determine 
c(t) = e%*u(t) x eètu(t). 

Fro Eq. (6.38), it follows that 


1 1 ji 1 
OO) > Gone at) il i 
The inverse transform of the above equation yields 


e(t) = le" —e'\u(t) B 


a- 


6.3 Solution of Differential and Integro-Differential Equations 


The time-differentiation property of the Laplace transform has set the stage 
for solving linear differential (or integro-differential) equations with constant co- 
efficients. Because d*y/dt* <> s*Y(s), the Laplace transform of a differential 
equation is an algebraic equation which can be readily solved for Y(s). Next we 
take the inverse Laplace transform of Y (s) to find the desired solution y(t). The 
following examples demonstrate the Laplace transform procedure for solving linear 
differential equations with constant coefficients. 


@ Example 6.9 
Solve the second-order linear differential equation 


(D? + 5D +6) y(t) = (D+ 1f(t) (6.42a) 


if the initial conditions are y(0~) = 2, y(07) = 1, and the input f(t) =e “*u(¢). 
The equation is 


Py | dy _ 4 
aa t5G tout) gt O (6.42b) 
Let 
u(t) = Y (s) 


Then from Eq. (6.34) 


au <=> sY(s)— y(0) = sY (s) -2 
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and 
d?y 2 = Se 2 
Ww? Y(s) — sy(07) — y(07) = s Y(s)-2s—1 


Moreover, for f(t) = e~**u(t), 


1 df 
Fle) = —1_ df = pasa s s 
(s) 544° and a => sF(s) f(0 )= py Gay 
Taking the Laplace transform of Eq. (6.42b), we obtain 
2 
s°Y(s) — 2s — 1| +5[sY (s) — 2] + 6Y(s) = —È Sea 
[ ] +5[s¥(s) -J +6Y()= -5 +- (6.43a) 


Collecting all the terms of Y(s) and the remaining terms separately on the left-hand side 
we obtain 


1 


2 s+1 
8° + 5s +6) Y(s) — (2 11) = 
( ) Y (8s) — (2s + 11) FF (6.43b) 
Therefore 
2 
(s? + 5s +6) Y (s) = (2s + 11) + St} n 287 + 20s + 45 
s+4 s+4 
and 
(s) = 2s? + 20s + 45 
(s? + 5s + 6)(s +4) 
_ __2s? + 20s + 45 
(s + 2)(s + 3)(s + 4) 
Expanding the right-hand side into partial fractions yields 
Y(s)= 13/2 3 _ 3/2 
S+2 64+3 s+4 
The inverse Laplace transform of the above equation yields 
y(t) = (Be — 3e _ $e" **) u(t) (6.44) 
a 


This example demonstrates the ease with which the Laplace transform can 
solve linear differential equations with constant coefficients. The method is general 
and can solve a linear differential equation with constant coefficients of any order. 


Zero-Input and Zero-State Components of Response 


The Laplace transform method gives the total response, which includes zero- 
input and zero-state components. It is possible to separate the two components if 
we so desire. The initial condition terms in the response give rise to the zero-input 
response. For instance, in Example 6.9, the terms arising due to initial conditions 
y(07) = 2 and y(0~) = 1 in Eq. (6.43a) generate the zero-input response. These 
initial condition terms are —(2s + 11), as seen in Eq. (6.43b). The terms on the 
right-hand side are exclusively due to the input. Equation (6.43b) is reproduced 
below with the proper labeling of the terms. 
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sl 
(8? + 5s +6) Y (8s) — (2s + 11) = FF 
so that 
(s? + 5s +6) Y (s) = (2s+11) + — 
initial condition terms aes 
Therefore 


2s +11 A s+1 
s2 +5s +6 (s + 4)(s? + 5s + 6) 


zero-input component zero-state component 


-|= apR 2 3/2 


Y (s) = 


s+2 8+3 


s+2 s+3 s8s+4 


Taking the inverse transform of this equation yields 


y(t) = (7e7** — 5e~**) u(t) + (—4e~™ + 2e% — 3e~**) u(t) 
Na pen |e ee 


zero-input response zero-state response 


Comments on Snitial Conditions at 0~ and at 0+ 


The initial conditions in Example 6.9 are y(07) = 2 and ġ(07) = 1. If we let 
t = 0 in the total response in Eq. (6.44), we find y(0) = 2 and y(0) = 2, which 
is at odds with the given initial conditions. Why? The reason is that the initial 
conditions are given at t = 07 (just before the input is applied), when only the zero- 
input response is present. The zero-state response is the result of the input f(t) 
applied at t = O. Hence, this component does not exist at t = 07. Consequently, 
the initial conditions at t = 07 are satisfied by the zero-input response, not by the 
total response. We can readily verify in this example that the zero-input response 
does indeed satisfy the given initial conditions at t = 07. It is the total response 
that satisfies the initial conditions at t = 0+, which are generally different from the 
initial conditions at 07. 

There also exists a £4 version of the Laplace transform, which uses the initial 
conditions at £ = Ot rather than at 07 (as in our present £_ version). The L+ 
version, which was in vogue till the early sixties, is identical to the £L- version 
except the limits of Laplace integral [Eq. (6.18)] are from O+ to oo. Hence, by 
definition, the origin t = 0 is excluded from the domain. This version, still used in 
some math books, has some serious difficulties. For instance, the Laplace transform 
of 6(t) is zero because 6(t) = 0 for t > 0*. Moreover, this approach is practically 
useless in the theoretical study of linear systems because the response obtained by 
this method cannot be separated into zero-input and zero-state components. As 
we know, the zero-state component represents the system response as an explicit 
function of the input, and without knowing this component, it is not possible to 
assess the effect of the input on the system response. The £4 version can separate 
the response in terms of the natural and the forced components, which are not 
as interesting as the zero-input and the zero-state components. Note that we can 
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always determine the natural and the forced components from the zero-input and 
the zero-state components (see Eq. (2.51b), but the converse is not true. Because 
of these and some other problems, electrical engineers (wisely) started discarding - 
the £, version in the early sixties. 

It is interesting to note the time domain duals of these two Laplace versions. 
The classical method is the dual of the L+ method, and the convolution (zero- 
input/zero-state) method is the dual of the L_ method. The first pair uses the 
initial conditions at 0+, and the second pair uses those at t = 07. The first pair 
(the classical method and the L4 version) is useless in the theoretical study of linear 
system analysis. It was no coincidence that the £_ version was adopted immediately 
after the introduction of the state-space analysis (which uses zero-input /zero-state 
separation of the input) to the electrical engineering community. 

A Exercise E6.6 

Solve 


dy dy df 
T +470 + 3y(t) = 2a + f(t) 


for the input f(t) = u(t). The initial conditions are y(07) = 1 and y(0-) = 2. 
Answer: y(t) = 3(1+9e-t —7e-3t)u(t) y 


1H 22 


10u(t) 


(a) (b) 


y(t) 


(c) 


t — 


Fig. 6.8 Analysis of a network with a switching action (Example 6.10). 


E Example 6.10 


In the circuit of Fig. 6.8a, the switch is in the closed position for a long time before 
t = 0, when it is opened instantaneously. Find the inductor current y(t) for t > 0. 

When the switch is in the closed position (for a long time), the inductor current is 
2 amps and the capacitor voltage is 10 volts. When the switch is opened, the circuit is 
equivalent to that depicted in Fig. 6.8b, with the initial inductor current y(0-) = 2 and 
the initial capacitor voltage ve(0~) = 10. The input voltage is 10 volts, starting at t = 0 
and, therefore, can be represented by 10u(t) 


y(t) Vo(t) 
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The loop equation of the circuit in Fig. 6.8b is 


W 4 oy(t) +5 ‘| y(r) dr = 10u(t) (6.45); 
i y(t) => Y (s8) (6.46a) 
then à vom sY (8) z y(07) P sY (8) —?2 (6.46b) 
and {see Eq. (6.36)] A 
t T)d 
i Joias ¥(s) k Lana (6.46c) 


A o7 : = A 
Because y(t) is the capacitor current, the integral fe y(r)dr is qc(07), the capacitor 
charge at t = 07, which is given by C times the capacitor voltage at t = 07. Therefore 


a y(r)dr = qc(07) = Cve(07) = =(10) =2 (6.47) 


= 


From Eq. (6.46c) it follows that 


f * jarem YO 42 (6.48) 


Taking the Laplace transform of Eq. (6.45) and using Eqs. (6.46a), (6.46b), and (6.48), we 


obtain 
5Y (s 10 10 
sy(s) -2+ 2y (s) + ese =— 


8 s s 
or 5 

[s +2+ 5] Y(s)=2 
and Qs 

ee 8? +2s +5 


To find the inverse Laplace transform of Y (s), we use Pair 10c (Table 6.1) with values 
A=2,B=0,a=1, and c = 5. This yields 


-1 n o 
r= [20 = v5, b= V/c—a? =2 and = tan (4) = 26.6 


Therefore 
y(t) = V5e™* cos (2t + 26.6°)u(t) 


This response is shown in Fig. 6.8c. a 


6.3-1 Zero-State Response: The Transfer Function of an LTIC System 
Consider an nth-order LTIC system specified by the equation 


Q(D)y(t) = P(D) F(t) 
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; OF 


(D” +an-1 D! 4.. t aD 4+ ag)y(t) = 
(bnD” + bn-1D”} +--+ +b1D + bo) f(t) (6.49) 
We shall now find the general expression for the zero-state response of an LTIC 
system. Zero-state response y(t), by definition, is the system response to an input 
when the system is initially relaxed (in zero state). Therefore, y(t) satisfies the 
system equation (6.49) with zero initial conditions 
y(07) = 907) = 907) = --- = y= (07) =0 


Moreover, the input f(t) is causal, so that 


(07) = FO") = fO)=---= fs" NO) =0 
Let 
y(t) == Y(s) and f(t) = F(s) 
Because of zero initial conditions 


da” 
Dy(t) = ge) <=> s"Y(s) 
af 


D* f(t) = ie 


f(t) => s*F(s) 
Therefore, the Laplace transform of Eq. (6.49) yields 


(Gi +an-1s™! +.. as + ao) Y (s) = (bns” + bys” +- + bis + bo) F(s) 


or 


¥(s) = bns” + by-is™ 1 +--+ bis + bo 


SP hag yeh ee pasta e) (6.50a) 
_ Pls) pu 
= G(s)" ) (6.50b) 


But we have shown in Eq. (6.41) that Y (s) = H(s)F(s). Consequently, 


H(s) = a (6.51) 


This equation was derived earlier in time-domain [see Eq. (2.50)]. Thus, 
Y (s) = H(s)F(s) (6.52) 


We have already derived this result twice using other approaches. We now have an 
alternate interpretation (or an alternate definition) for the transfer function H (s). 
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BUT BOSS I’m sure Ka 
THE POLES were in 
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Game 


It is the ratio of Y(s) to F(s) when all the initial conditions are zero (when the 
system is in zero state). Thus 


_ ¥(s) _ Llzero-state response] 
H(s)= Fis) > Ejinput) (6.53) 


We have shown that Y (s), the Laplace transform of the zero-state response y(t), 
is the product of F(s) and H(s), where F(s) is the Laplace transform of the input 
f(t) and H(s) is the system transfer function [relating the particular output y(t) to 
the input f(t)]. Observe that the denominator of H (s) is Q(s), the characteristic 
polynomial of the system. Therefore, the poles of H (s) are the characteristic roots 
of the system. Consequently, the system stability criterion can be stated in terms 
of the poles of the transfer function of a system, as follows: 


1. An LTIC system is asymptotically stable if and only if all the poles of its transfer 
function H (s) are in the LHP. The poles may be repeated or unrepeated. 


2. An LTIC system is unstable if and only if either one or both of the following 
conditions exist: (i) at least one pole of H (s) is in the RHP; (ii) there are 
repeated poles of H(s) on the imaginary axis. 


3. An LTIC system is marginally stable if and only if there are no poles of H (s) 
in the RHP, and there are some unrepeated poles on the imaginary axis. 


We can now represent the transformed version of the system, as depicted in 
Fig. 6.9. The input F(s) is the Laplace transform of f (t), and the output Y(s) is 
the Laplace transform of (the zero-input response) y(t). The system is described 
by the transfer function H (s). The output Y (s) is the product F(s)H (s). 

The result Y(s) = H(s)F(s) greatly facilitates derivation of the system re- 
sponse to a given input. We shall demonstrate this assertion this by an example. 


@ Example 6.11 
Find the response y(t) of an LTIC system described by the equation 
dy _ „dy 


TY 4 5M + oyli) = FETTO) 
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F(s) | a | ¥(s)=F(s)H(s) 
H (s) 


Fig. 6.9 The transformed representation of an LTIC system. 


if the input f(t) = 3e~°'u(t) and all the initial conditions are zero; that is, the system is 
in zero-state. 


The system equation is 


(D? +5D +6) y(t) = (D +1) f(t) 
alien tyrone, —-— 


Q(D) P(D) 
Therefore ( 
_ P(s)_ s+i 
His) = Q(s) s?4+53+6 
Also 
F(s)=L [3e~**u(t)] z : 5 
and 
3) = Fls)H(s) = 3(s + 1) 
Y (8) = F(s)H (s) (s + 5)(s? + 5s + 6) 
_ 3(s +1) 
(s + 5)(s + 2)(s + 3) 
-2 1 3 
= + 


s+5 s+2 s+3 


The inverse Laplace transform of this equation is 


y(t) = (—2e7** -e4 3e7**) u(t) E 


E Example 6.12 
Show that the transfer function of 
(a) an ideal delay of T seconds is e~*7; 


(b) an ideal differentiator is s; 


(c) an ideal integrator is 1/s. 


(a) Ideal Delay 
For an ideal delay of T seconds, the input f(t) and output y(t) are related by 


y(t) = f(t— T) 
or 
Y (s) = F(s)e~*7 [see Eq. (6.29a)] 
Therefore 


H(s) = ae = eT (6.54) 
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(b) Ideal D ifferentiator 
For an ideal differentiator, the input f(t) and the output y(t) are related by 


d 
s) = 


The Laplace transform of this equation yields 


Y (s) = sF (s) [f(07) = 0 for a causal signal] 


and 
Srei (6.55) 
H ( ) To F( 8) =8 
(c) Ideal Integrator B 
For an ideal integrator with zero initial state, that is y(07} = 9, 
t 
vO = | Hoar 
0 
and i 
Y(s)= 5 FCs) 
Therefore 
HVS (6.56) 
s 
@ 
A Exercise E6.7 ; 
For an LTIC system with transfer function 
s+5 
HOS ars 


(a) Describe the differential equation relating the input f(t) and output y(t). 
(b) Find the system response y(t) to the input f (t) = e~%*u(t) if the system is initially in 
zero state. 


Answers: (a) oe + a% + 3y(t) = 4 +5f(t) (b) y(t) = (2e7t — 3e7? + et) u(t) v 


6.4 Analysis of Electrical Networks: The Transformed Network 


Example 6.10 shows how electrical networks may be analyzed by writing the 
integro-differential equation(s) of the system and then solving these equations > 
the Laplace transform. We now show that it is also possible to analyze electrica 
networks directly without having to write the integro-differential equations. This 
procedure is considerably simpler because it permits us to treat an electrical network 
as if it were a resistive network. For this purpose, we need to represent a network 
in the “frequency domain” where all the voltages and currents are represented by 
their Laplace transforms. , DA 7 

For the sake of simplicity, let us first discuss the case with zero initial conditions. 
If v(t) and i(t) are the voltage across and the current through an inductor of L 


henries, then i 
v(t) = Le 


The Laplace transform of this equation (assuming zero initial current) is 


V(s) = LsI(s) 
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Similarly, for a capacitor of C farads, the voltage-current relationship is i(t)=C dy 
and its Laplace transform, assuming zero initial capacitor voltage, yields I (s) = 
CsV(s); that is, 


V(s) = a1) 


For a resistor of R ohms, the voltage-current relationship is u(t) = Ri(t), and its 
Laplace transform is 


V(s) = RI(s) 


Thus, in the “frequency domain,” the voltage-current relationships of an inductor 
and a capacitor are algebraic; these elements behave like resistors of “resistance” 
Ls and 1/Cs, respectively. The generalized “resistance” of an element is called its 
impedance and is given by the ratio V(s)/I(s) for the element (under zero initial 
conditions). The impedances of a resistor of R ohms, an inductor of L henries, and 
a capacitance of C farads are R, Ls, and 1/C’s, respectively. 

Also, the interconnection constraints (Kirchhoff’s laws) remain valid for volt- 
ages and currents in the frequency domain. To demonstrate this point, let u;(t) 
(j=1, 2,..., k) be the voltages across k elements in a loop and let i;(t) (j = 1, 2, 

. ,m) be the j currents entering a node. Then 


k m 
v(t) =0 and Salt) =0 (6.57) 
j=l j=l 
Now if 
uj(t) = V;(s) and ij(t) <=> 1;(s) 
then 


k m 
YO V;(s)=0 and X (s) =0 (6.58) 
j=l j=l 


This result shows that if we represent all the voltages and currents in an electrical 
network by their Laplace transforms, we can treat the network as if it consisted 
of the “resistances” R, Ls and 1/Cs corresponding to a resistor R, an inductor 
L, and a capacitor C, respectively. The system equations (loop or node) are now 
algebraic. Moreover, the simplification techniques that have been developed for 
resistive circuits-—-equivalent series and parallel impedances, voltage and current 
divider rules, Thévenin and Norton theorems—can be applied to general electrical 
networks. The following examples demonstrate these concepts. 


E Example 6.13 

Find the loop current i(t) in the circuit shown in Fig. 6.10a if all the initial conditions 
are zero. 

In the first step, we represent the circuit in the frequency domain, as illustrated in 
Fig. 6.10b. All the voltages and currents are represented by their Laplace transforms. The 
voltage 10u(t) is represented by 10/s and the (unknown) current i(t) is represented by 
its Laplace transform I(s). All the circuit elements are represented by their respective 
impedances. The inductor of 1 henry is represented by s, the capacitor of 1/2 farad is 
represented by 2/s, and the resistor of 3 ohms is represented by 3. We now consider the 
frequency-domain representation of voltages and currents. The voltage across any element 
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1H 32 s 3 


10u (t) 


(a) (b) 


Fig. 6.10 A circuit and its transformed version (Example 6.13). 


is I(s) times its impedance. Therefore, the total voltage drop in the loop is I(s) times the 
total loop impedance, and it must be equal to V(s), (transform of) the input voltage. The 
total impedance in the loop is 


2 
At ee ee s +3s+2 

s s 
The input“voltage” is V (s) = 10/s. Therefore, the “loop current” I(s) is 


V (s) sae 10 _ 10 10 
s?4+3s+2 (st+i1)(s+2) s+1 s+2 


Z(s) s243s+2 
s 


I(s) = 


The inverse transform of this equation yields the desired result: 


i(t)=10(e*-e u(t) E 


Initial Condition Generators 


The above discussion, where we assumed zero initial conditions, can be readily 
extended to the case of nonzero initial conditions because the initial condition in a 
capacitor or an inductor can be represented by an equivalent source. We now show 
that a capacitor C with an initial voltage v(0) (Fig. 6.11a) can be represented in 
the frequency domain by an uncharged capacitor of impedance 1/Cs in series with 
a voltage source of value v(0)/s (Fig. 6.11b) or as the same uncharged capacitor in 
parallel with a current source of value Cv(0) (Fig. 6.11c). Similarly, an inductor L 
with an initial current i(0) (Fig. 6.11d) can be represented in the frequency domain 
by an inductor of impedance Ls in series with a voltage source of value Li(0) (Fig. 
6.11e) or by the same inductor in parallel with a current source of value i(0)/s (Fig. 
6.11f). To prove this point, consider the terminal relationship of the capacitor in 


Fig. 6.11a 
: dv 
i(t) =C a 
The Laplace transform of this equation yields 


I(s) = C[sV(s) — v(0)} 
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itt) : HOE 2 BG): 
+ 
v(t) v(0) 
E Cy (0) 
@) O © 
i(t) T(s) -> Is) 
Ls 
v(t) Vis) 
L i 
Li(0) 
@ (e) 


Fig. 6.11 Initial condition generators for a capacitor and an inductor. 


This equation can be rearranged as 


1 v(0 
V(s)= Geils) + 20 (6.59a) 
Observe that V (s) is the voltage (in the frequency domain) across the charged 
capacitor and I(s)/C's is the voltage across the same capacitor without any aie e 
Therefore, the above equation shows that the charged capacitor can be i SH 
by the same capacitor (uncharged) in series with a voltage source of value v(0)/s 
as depicted in Fig. 6.11b. Equation (6.59a) can also be rearranged as l 


V (s) = = [I(s) + Cv(0)| (6.59b) 


This equation Shows that the charged capacitor voltage V(s) is equal to the un- 
charged capacitor voltage caused by a current J (s) + Cv(0). This result is re- 


flected precisely in Fi 
g. 6.11c, where the current through the uncharged i 
; c 
is I(s) + Cv(0).4 i TNTA 
Se 
fIn the time domain, a charged i ith initi 
ged capacitor C with initial voltage v(0) can be represented 
t a ; c thi 

same aparitor uncharged in series with a voltage source v(O)u(t), or in Baratial with Š suiten 

rce C'v(0)6(t). Similarly, an inductor L with initial current i(0) can be represented by the same 


inductor with zero initial c i i i i i 
cares OUT urrent in series with a voltage source Li(0)6(t) or with a parallel current 
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For the inductor in Fig. 6.11d, the terminal equation is 


di 
‘epee 
WS he 


and 
V(s) = L[sI(s) — i(0)] 


= LsI(s) — Li(0) (6.60a) 


=Ls [ns z ad (6.60b) 


We can verify that Fig. 6.1le satisfies Eq. (6.60a) and that Fig. 6.11f satisfies Eq. 
(6.60b). 


1H 2 


10u (t) 


(a) (b) 


Fig. 6.12 A circuit and its transformed version with initial condition generators (Example 
6.12). 


Let us rework Example 6.10 using these ideas. Figure 6.12a shows the circuit 
in Fig. 6.8b with the initial conditions y(0) = 2 and vc(0) = 10. Figure 6.12b 
shows the frequency-domain representation (transformed circuit) of the circuit in 
Fig. 6.12a. The resistor is represented by its impedance 2; the inductor with initial 
current of 2 amps is represented according to the arrangement in Fig. 6.1le with 
a series voltage source Ly(0) = 2. The capacitor with initial voltage of 10 volts 
is represented according to the arrangement in Fig. 6.11b with a series voltage 
source v(0)/s = 10/s. Note that the impedance of the inductor is s and that of the 
capacitor is 5/s. The input of 10u(t) is represented by its Laplace transform 10/s. 

The total voltage in the loop is 40 +2- 12 = 2, and the loop impedance is 
(s+2+ 8), Therefore 


2 
s+2+8 
2s 
s? +2s+5 


Y(s)= 


which confirms our earlier result in Example 6.10. 
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v 
+c- AO 1Q y% (0)=16 
æv] |F = meer 
4V 
= oi (a) 


(c) 


F ig. 6.13 Solving Example 6.14 using in 
g1 itial condition enerators and T hévenin equivalent 
g 


E Example 6.14 


The switch in the circuit of Fig. 6.13a is in the closed position for a long time before 
t =0, when it is opened instantaneously. Find the currents yi(t) and y2(t) for t > 0. 


inductor current of 4 amps is represented by a source of value Ly2(0) = 2. 
From Fig. 6.13b, the loop equations can be written directly in the frequency domain 
as 
Yı (s) 


iG- ¥4(s)] = 4 
8 


1 6 s 
—5¥(s) + 5 Y2(s) + 3 ¥a(s) 32 


ith -Eo ji 
-3 gy A Y2(s) 2 
Application of Cramer's rule to this equation yields 
24(s + 2) 
Yi(s) = ——— 
ale) a +12 
24(s + 2) -24 48 


~ (8+3)(s+4) 343544 
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and 
yi(t) = (-24e7% + 48e7*) u(t) 
Similarly, we obtain 
4(s +7) 
s? + 7s +12 


16 12 
s+3 3+4 


Y2(s) = 


and 
ya(t) = (16e~** ~ 12e~ **) u(t) 


We also could have computed Yi(s) and Y2(s) using Thévenin’s theorem by replacing 
the circuit to the right of the capacitor (right of terminals ab) with its Thévenin equivalent, 
as shown in Fig. 6.13c. Figure 6.13b shows that the Thévenin impedance Z(s) and the 
Thévenin source V(s) are: 


According to Fig. 6.13c, the current Yi(s) is given by 
$ - V(s) 
++ Z(s) 


_ _24(s+2) 
82 4+7s+12 


Yı (s) = 


a conclusion which confirms the earlier result. We may determine Y2(s) in a similar 
manner. W 


a Example 6.15 

The switch in the circuit in Fig. 6.14a is at position a for a long time before t = 0, 
when it is moved instantaneously to position b. Determine the current y1(t) and the output 
voltage vo(t) for t > 0. 

Just before switching, the values of the loop currents are 2 and 1, respectively, that 
is; yı(07) = 2 and y2(07) = 1. 

The equivalent circuits for two types of inductive couplings are illustrated in Figs. 
6.14b and 6.14c. For our situation, the circuit in Fig. 6.14c applies. Fig. 6.14d shows the 
transformed version of the circuit in Fig. 6.14a after switching. Note that the inductors 
Lı + M, L2 + M, and -M are 3,4, and —1 henries with impedances 3s, 4s, and —s 
respectively. The initial condition voltages in the three branches are (Li + M)yi(0) = 6, 
{L2 + M)y2(0) = 4, and — M [y1 (0) — y2(0)} = —1, respectively. The two loop equations of 
the circuit aret 


{The time domain equations (loop equations) are 


d d 
L1 T + (Ri + Rajni (t) — Royalt) + MF = 10u(t) 


d d 
mÝ — Rayı (t) + Lo + (Re + Rs)v2(t) = 0 


The Laplace transform of these equations yields Eq. (6.61). 


(a) 


Fig. 6.14 The Laplace tra; 


nsform analysis of a co 
by the transformed circuit method. : 


pled inductive network (Example 6.15) 


(2s + 3)¥i(s) + (s — 1)¥2(s) = 10s 


s 


(s = 1)¥i(s) + (3 = 
. 1(s) + (38 + 2)¥a(s) = 5 (6.61) 


s—1] [Yi(s)] pē 
s-1 a eal 5 
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and 
2s? +9844 
e= s(s? + 3s +1) 
e E EEE ES 
~ s 6+0.382 s+2.618 
Therefore 
yi(t) = (4 — 970-382 _ ere) u(t) 
Similarly 
2 
s“ +2842 
Ya(s) = s(s? + 33 +1) 
_2 1618 0.618 
~ s 8s+0.382  s+2.618 
and 


ya(t) = (2 — 1.618" °° + 0.618771") u(t) 
The output voltage 


volt) = ya(t) = (2 — 1.618e7 °° + 0.61877") u(t) W 


A Exercise E6.8 


For the RLC circuit in Fig. 6.15, the input is switched on at t = 0. The initial conditions 
are y(07) = 2 amps and v¢(0) = 50 volts. Find the loop current y(t) and the capacitor voltage 
ve(t) for t > 0. 


Answer: 


y(t) = 10V2e-* cos (2t + 81.8°)u(t), volt) = [24 + 31.62e-* cos (2t — 34.7°)}u(t) 7 


Fig. 6.15 Circuit for Exercise E6.8. 


6.4-1 Analysis of Active Circuits 


Although we have considered examples of only passive networks so far, the 
circuit analysis procedure using the Laplace transform is also applicable to active 
circuits. All that is needed is to replace the active elements with their mathematical 
models (or equivalent circuits) and proceed as before. 

The operational amplifier (depicted by the triangular symbol in Fig. 6.16a) 
is a well-known element in modern electronic circuits. The terminals with the 
positive and the negative signs correspond to noninverting and inverting terminals, 
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+ 
Kv, {t) v {t) 


(d) 


Fig. 6.16 Operational amplifier and its equivalent circuit. 


respectively. This means that the polarity of the output voltage v2 is the same as 
that of the input voltage at the terminal marked by the positive sign (noninverting). 
The opposite is true for the inverting terminal, marked by the negative sign. 

Figure 6.16b shows the model (equivalent circuit) of the operational amplifier 
(op amp) in Fig. 6.16a. A typical op amp has a very large gain. The output voltage 
v2 = —Av, where A is typically 10° to 106. The input impedance is very high 
(typically 10°Q for BJT to 10!? 9 for Bi-FET), and the output impedance is very 
low (50 to 1002). For most applications, we are justified in assuming the gain A 
and the input impedance to be infinite and the output impedance to be zero. For 
this reason we see an ideal voltage source at the output. 

Consider now the operational amplifier with resistors Ra and Rp connected, as 
shown in Fig. 6.16c. This configuration is known as the noninverting amplifier. 
Observe that the input polarities in this configuration are inverted when compared 


to those in Fig. 6.16a. We now show that the output voltage v2 and the input 
voltage v; in this case are related by 


vg = Kv, K=1+ (6.62) 


First, we recognize that because the input impedance and the gain of the operational 
amplifier approach infinity, the input current is and the input voltage vz in Fig. 
6.16c must approach zero. The dependent source in this case is Av, instead of 
~Avz because of the input polarity inversion. The dependent source Avy (see Fig. 
6.16b) at the output will generate current ig, as illustrated in Fig. 6.16c. Now 


vg = (Re + Radio 
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also 
vy = Vg + Raio 
= Raio 
Therefore 
R R R 

we Rot Ra =1+ 2b LK 

vi Ra Ra 
or 


v2(t) = Kv(t) 


The equivalent circuit of the noninverting amplifier is depicted in Fig. 6.16d. 


E Example 6.16 
The circuit in Fig. 6.17a is called the Sallen-Key circuit, which is frequently used 
in filter design. Find the transfer function H (s) relating the output voltage vo(t) to the 
input voltage v;(t). 
We are required to find 
_ Vols) 
Vi(s) 


H(s) 


assuming all initial conditions to be zero. 

Figure 6.17b shows the transformed version of the circuit in Fig. 6.17a. The nonin- 
verting amplifier is replaced by its equivalent circuit. All the voltages are replaced by their 
Laplace transforms and all the circuit elements are shown by their impedances. All the 
initial conditions are assumed to be zero, as required for determining H (s). 

We shall use node analysis to derive the result. There are two unknown node voltages, 
Va(s) and V;(s), requiring two node equations. 

At node a, Ir, (s), the current in R, (leaving the node a), is [Va(s) — Vi(s)]/R1. Sim- 
ilarly, Ip, (s), the current in Rg (leaving the node a), is [Va(s) — Vo(s)]/R2 and Ic, (s), the 
current in capacitor C; (leaving the node a), is [Va(s) — Vo(s)]Cis = [Va(s) — KVb(s)]Cis. 

The sum of all the three currents is zero. Therefore 


Va(s) ~ Vis) , Vals) — Vols) 


Ri Ro F [Va(8) = KV;,(s)} Cis =0 


or 


Gx + 5 + C18) Vals) - (È + KC18) Vals) = gvo) (6.63a) 


Similarly, the node equation at node b yields 


Vils} — Vals) 
2 


+ CosVi(s) = 0 
or 
1 1 
as 1 z 63b 
Vals) + ( mt Cas) Vi(s) =0 (6.63b) 


The two node equations (6.63a) and (6.63b) in two unknown node voltages Va(s) and V3(s) 
can be expressed in matrix form as 


Git+G2e+Cis ay be ee | 
Gs (G2+Crs) | Lv] 


(6.64) 
0 


where 
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(b) 


Fig. 6.17 Sallen-Key circuit and its equivalent. 


Gi = => and G2 = — 


Application of Cramer’s rule to Eq. (6.64) yields 


Vo(s) _ GiG2 
Se ns GIG ne a 
Vi(s) CrC2s? + [(GiG2 + G2C2 +G201(1 — K)]s + GiGa 
2 
wo 


8? + 2as + wo? 


where 
Rete and ara ee a aala 
Ra CiC2 Ri R2CiC2 
2a = CLC + G2C2 + G2Ci(1 — K) ik os 1 i 
C1C2 ~ RiC, * RiC2 t RG," wae 
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(6.65a) 


(6.65b) 
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Now 
Vo(s) = KVo(s) 
Therefore 


_ Vols) _ Vols) Kwè (6.66) 


HC) = Vie) É Vils) 7 32+ Bas F wo 


6.4-2 Initial and Final Values 


In certain applications, it is desirable to know the values of f(t) ast > 0 and 
t — oo [initial and final values of f (t)] from the knowledge of its Laplace transform 
F(s). Initial and final value theorems provide such information. 


The initial value theorem states that if f(t) and its derivative df/dt are 
both Laplace transformable, then 


+) = li (6.67) 
f(0*) = Jim sF(s) 
provided that the limit on the right-hand side of Eq. (6.67) exists. 


The final value theorem states that if both f(t) and df/dt are Laplace 
transformable, then 


Jim f(t) = lim sF (s) (6.68) 


provided that s F(s) has no poles in the RHP or on the imaginary axis. To prove 
these theorems, we use Eq. (6.34a) 


sF (8s) — f(07) = edt 


or o0 
df —st f df —st d 
= = —e t 
= A ai e dt+ + dt 


ot R œ gf 
j o+ dt 


= œ af -st 
s00) f Feas 


œ gf 
- dt 


= F(t) Bone 


Therefore 
Ea df —st 
sF(s) = f(0*) ae een 


and 


im sF(s) = f(0*) + lim A É est dt 
pim s (s) = o+ dt 


$—700 


= f(0*) + f o S (2m e) at 


ot 
= f(0*) 


6.5 Block Diagrams 4il 


Comment: The initial value theorem should be applied only if F(s) is strictly 
proper (m < n), because for m > n, lims—oo sF (s) does not exist, and the theorem 
does not apply. 


To prove the final value theorem, we let s — 0 in Eq. (6.34a) to obtain 


. _ . œ d i o g 
lig [oF (s)— f(0")] = tig | Ketao [La 
=F = fim s(t) - £07) 
Š 


a deduction which leads to the desired result (6.68) 

Comment: The final value theorem applies only if the poles of sF (s) are in 
the LHP. If there is a pole on the imaginary axis, then lims—o sF (s) does not exist. 
If there is a pole in the RHP, lim;_,o f(t) does not exist. 


| Example 6.17 
Determine the initial and final values of y(t) if its Laplace transform Y (s) is given by 


10(2s + 3) 


YOS s(s? + 2s + 5) 


Equations (6.67) and (6.68) yield 


ore _ yp _10(28 +3) _ 

UO a OS ne Geran ah 
= y _10(25+3) _ 

vice) = lim sY (s) = lim Grasi N 


6.5 Block Diagrams 


Large systems may consist of an enormous number of components or elements. 
Analyzing such systems all at once could be next to impossible. Anyone who has 
seen the circuit diagram of a radio or a TV receiver can appreciate this fact. In such 
cases, Ít is convenient to represent a system by suitably interconnected subsystems, 
each of which can be readily analyzed. Each subsystem can be characterized in 
terms of its input-output relationships. A linear (sub)system can be characterized 
by its transfer function H (s). Figure 6.18a shows a block diagram of a system with 
a transfer function H(s) and its input and output represented by their frequency 
domain descriptions F (s) and Y (s) respectively. 

Subsystems may be interconnected by using three elementary types of inter- 
connections (Figs. 6.18b, 6.18c, 6.18d): cascade, parallel, and feedback. When two 
transfer functions appear in cascade, as depicted in Fig. 6.18b, the transfer function 
of the overall system is the product of the two transfer functions. This conclusion 
follows from the fact that in Fig. 6.18b 


Y(s) _ W(s) ¥(s) 
FG) ` Fl) W(s) 


This result can be extended to any number of transfer functions in cascade. 


= H1(s)H2(s) 
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roe] ro ro ° 
F(s) W(s) Y(s) F(s) Y(s) 
= k aie 


(b) 


F(s) ¥(s) 
= H, (s)+H,(s) 


(c) 


F(s) Y (s) 
= G(s) 
= 1+G(s)H(s) 


(d) 


Fig. 6.18 Elementary connections of blocks and their equivalents. 


Similarly, when two transfer functions, H1 (8) and H2(s), appear in parallel, $ 
illustrated in Fig. 6.18c, the overall transfer function is given by Hi(s)+ Ho(s), the 
sum of the two transfer functions. The proof is trivial. This result can be extended 

systems in parallel. 
j “When | ae ae is fed sek to the input, as shown in Fig. 6.18d, the overall 
transfer function Y (s)/F (s) can be computed as follows. The inputs to the summer 
are F(s) and —H (s)Y (s). Therefore, E(s), the output of the summer, is 


E(s) = F(s) — H (s)Y (s) 
But 


Therefore 
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so that 
¥(s)___ G(s) 
F(s) 1+G(s)H(s) 


Therefore, the feedback loop can be replaced by a single block with the transfer 
function shown in Eq. (6.69) (see Fig. 6.18d). 

In deriving these equations, we implicitly assume that when the output of one 
subsystem is connected to the input of another subsystem, the latter does not load 
the former. For example, the transfer function H 1(s) in Fig. 6.18b is computed 
by assuming that the second subsystem H2(s) was not connected. This is the 
Same as assuming that Ho(s) does not load H i(s). In other words, the input- 
output relationship of Hı (s) will remain unchanged regardless of whether H2(s) is 
connected or not. Many modern circuits use op amps with high input impedances, 
so this assumption is justified. When such an assumption is not valid, Hy(s) must 
be computed under operating conditions (that is, when H 2(s) is connected). 

The MATLAB example C6.3 allows us to determine the transfer function of 


the feedback system in Fig. 6.18d [Eq. (6.69)], when the transfer functions G (s) and 
H (s) are given. 


(6.69) = 


© Computer Example C6.3 

Find the transfer function of the feedback system of Fig. 6.18d when G(s) = ay 
H(s) = 1, and K = 7, 16, and 80. 

For the sake of generalization, we shall split G(s) into two terms Gi(s) = K and 
Go(s) = Pen Such generalization allows us to use this program when G(s) is made up 
of two subsystems in cascade. 

% (c62.m) 

Glnum=(0 0 K]};Giden=[0 0 1); 

G2num=[0 0 1};G2den=[1 8 0}; 

Hnum=(0 0 1];Hden=[0 0 1); 

[Gnum,Gden]=series(G1num,G1den,G2num,G2den); 

[ClGnum,ClGden]=feedback(Gnum,Gden,Hnum,Hden); 

printsys(CIGnum,ClGden) 


The feedback transfer function, when K = 7, 16, and 80, can be obtained by the 
following MATLAB commands: 


K=7;c62 
num/den = 


K=16,c62 
nun/den = 


s°2+8s + 16 
K=80;c62 
num/den = 


s°2 + 8s + 80 © 
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6.6 System realization 


We now develop a systematic method for realization (or simulation) of an arbi- 
trary nth-order transfer function. Since realization is basically a synthesis problem, 
there is no unique way of realizing a system. A given transfer function can be re- 
alized in many different ways. We present here three different ways of realization: 
canonical, cascade and parallel realization. The second form of canonical realiza- 
tion is discussed in Appendix 6.1 at the end of this chapter. A transfer function 
H (s) can be realized by using integrators or differentiators along with summers and 
multipliers. For practical reasons we avoid the use of differentiators. A differen- 
tiator accentuates high-frequency signals, which, by their nature, have large rates 
of change (large derivative). Signals, in practice, are always corrupted by noise, 
which happens to be a broad-band signal; that is, the noise contains components of 
frequencies ranging from low to very high. In processing desired signals by a differ- 
entiator, the high-frequency components of noise are amplified disproportionately. 
Such amplified noise may swamp the desired signal. The integrator, in contrast, 
tends to suppress a high frequency signal by smoothing it out. In addition, practical 
differentiators built with op amp circuits tend to be unstable. For these reasons we 
avoid differentiators in practical realizations. 

Consider an LTIC system with a transfer function 


H(s) = ome + bm—13™7! +++: + bis + bo 
s” +an_18"71 +--+ + ays +a 


For large s (s — oo) 
H(s) ~ bms™~” 


Therefore, for m > n, the system acts as an (m — n)th-order differentiator [see 
Eq. (6.55)]. For this reason, we restrict m < n for practical systems. With this 
restriction, the most general case is m = n with the transfer function 


H = 
(s) s” + an_-1s"-14.---+a 18+ a9 


(6.70) 


Y(s) 


FCS) | bP +bt+b seb, |Y) F (s) i 
p Stat + ays+ ay. 


bys? + bys? + bst 
H,(s) Hy (s) 
(a) (b) 


Fig. 6.19 Realization of a transfer function in two steps. 


6.6-1 Canonical or Direct-Form Realization 


Rather than realizing the general nth-order system described by Eq. (6.70), we 
begin with a specific case of the following third-order system and then extend the 
results to the nth-order case 
= bzs? + bos? + bis + bo 


E 6.71 
(s) s3 + ags? + a1s + ap oe 
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x(t) x(t) x(t) x(t) 
u PHPH ZE S| M 
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Fig. 6.20 Realization of Hı(s) = 


1 
s3 a8? +a; stag 


For convenience of realization, we shall express this transfer function as a cas- 
cade of two transfer functions Hı(s) and Ho(s), as depicted in Fig. 6.19. 


H(s) = (scarce) (b38? + bos? + bys + bo) (6.72) 
— mo enn 
The output of H; (s) is denoted by X (s), as illustrated in Fig. 6.19b. Therefore 
aa Y (8) = (b3s° + bos? + bys + bo) X(s) (6.73) 
X(s)= l F(s) (6.74) 


s3 + ags? + ais + ao 


We shall first realize H,(s). Equation (6.74) enables us to write the differential 
equation relating z(t) to f(t) as 


R (D? +a2D? + aD + ao)z(t) = f(t) (6.75a) 


E(t) + azë(t) + aiż(t) + aoz(t) = f(t) (6.75b) 
a deduction which yields 


E(t) = —a2&(t) — aż (t) — agz(t) + f(t) (6.75c) 
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Our task is to realize a system whose input f(t) and output z(t) satisfy Eq. (6.75c). 
Let us assume that # is available. Successive integration of 7 yields 7, ż, and x (Fig. 
6.20a). We can now generate ï from f(t), z, 2, and according to Eq. (6.75c), 
using the feedback connections, as shown in Fig. 6.20b.{ The reader can verify that 
the system in Fig. 6.20b indeed satisfies Eq. (6.75c). Clearly, the transfer function 
of this system (Fig. 6.20b) is Hı(s) in Eq. (6.72). The signals a(t), a(t), and 
z(t) are available at points Ni, N2, and N3, respectively. If the initial conditions 
2(0), x(t), and Z(0) are nonzero, they should be added at points Ny, N2, and N3, 
respectively.t Figure 6.20c shows the system of Fig. 6.20b in frequency domain. 
Each integrator is represented by the transfer function 1/s [see Eq. (6.56)]. Signals 
f(t), z(t), z(t), z(t), and Z(t) are represented by their Laplace transforms F(s), 
X(s), sX (s), s?X(s), and s°X(s), respectively. 


wt 2 3 +b287+b) sb 
Fig. 6.21 Realization of H(s) = tag tag that 


Figure 6.20c is a realization of the transfer function H;(s) in Eq. (6.72). To 
realize the transfer function H(s), we need to augment Hj(s) so that the final 
output Y (s) is generated from X (s) according to Eq. (6.73): 


Y (8) = (b38 + bos” + bis + bo) X (s) 
= bzs? X (s) + b23? X (s) + bys.X(s) + bo X (8) 
Signals X (s), sX(s), s*X(s), and sĉX (s) are available at various points in Fig. 
6.20c so that Y (s) can be generated by using feedforward connections to the output 
summer, as depicted in Fig. 6.21. Therefore, the realization in Fig. 6.21 has the 
desired transfer function H (s) in Eq. (6.71). 


i ha Z,z, x by its successive 
It may seem odd that we first assumed the existence of ț and generated Ë, t, £ y ess 

kiea and then in turn generated 2% from ë, ¢, and z. This procedure poses a dilemma similar 
to “Which came first, the chicken or egg?” The problem here is satisfactorily resolved by writing 
the expression for Z at the output of the summer in Fig. 6.20b and verifying that this expression 
is indeed the same as Eq. (6.75c). a ; 
{For example, the initial condition z(0) can be incorporated into our realization by adding a 
constant signal of value z(0) at point N1. This follows from the fact that h a(r)dr = z(t) — (0), 
and z(t) = 2(0)+ fo a(r)dr. Similarly, the initial condition (0) should be added at point No, 
and so on. 
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Fig. 6.22 Realization of the nth-order transfer function H(s) in Eq. (6.70). 


Generalization of this realization for the nth-order transfer function in Eq. 
(6.70) is shown in Fig. 6.22. This is one of the two canonical realizations (also 
known as the controller canonical or direct-form realization). The second 
canonical realization (observer canonical realization) is discussed in Appendix 6.1 
at the end of this chapter. Observe that n integrators are required for a realization 
of an nth-order transfer function. The canonical (direct-form) realization procedure 
of an nth-order transfer function is systematic and straightforward, as illustrated in 
Fig. 6.22. After examining this figure, we can summarize the procedure as follows: 


1. Draw an input summer followed by n integrators in cascade. 


2. Draw the n feedback connections from the output of each of the n integrators 
to the input summer. The n feedback coefficients are a0, 41,02, °*-, @n-1, 
respectively, and the feedback connections have negative signs (for subtraction) 
at the input summer. 

3. Draw the n + 1 feedforward connections to the output summer from the out- 
puts of all the n integrators and the input summer. The n + 1 feedforward 
coefficients are bo, b1, b2, +++, bn, respectively, and the feedforward connections 
have positive signs (for addition) at the output summer. Observe that the con- 
nections ax and bx start from the same point. Thus, the connections ag and bo 
start at the same point, and so do connections a, and bı, and so on. 

Note that an is assumed to be unity and does not appear explicitly anywhere 
in the realization. If a, #1, then H (s) should be normalized by dividing both its 
numerator and its denominator by ay. 


E Example 6.18 
Find the canonical realization of the following transfer functions. 


5 s+5 s 4s + 28 
(a) s+2 (b) s+7 (e) s+7 (a) s2? +6s +5 
All four of these transfer functions are special cases of H (s) in Eq. (6.70). 


(a) In this case, the transfer function is of the first order (n = 1); therefore, we need 
only one integrator for its realization. The feedback and feedforward coefficients are 
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F(s) Y(s) 


Fig. 6.23 Realization of 35 


ao=2 and b=5 bh =0 


The realization is depicted in Fig. 6.23. Because n = 1, there is a single feedback connection 
from the output of the integrator to the input summer with coefficient a9 = 2. For n = 1, 
there are n + 1 = 2 feedforward connections in general. However, in this case, bı = 0, 
and there is only one feedforward connection with coefficient bo = 5 from the output of 
the integrator to the output summer. Observe that because there is only one signal to 
be summed at the output summer, a summer is not needed. For this reason, the output 
summer is omitted in Fig. 6.23. 


(b) 8 
mott 


The realization appears in Fig. 6.24. Here H(s) is a first order transfer function with 
ao = 7 and bo = 5, bı = 1. There is a single feedback connection (with coefficient 7) from 
the integrator output to the input summer. There are two feedforward connections from 
the outputs of the integrator and the input summer to the output summer.t 


(c) s 
s+7 


This first-order transfer function is similar to that in (b), except that bo = 0. Therefore, 
the realization is similar to that in Fig. 6.24 with the feedforward connection from the 
output of the integrator missing, as depicted in Fig. 6.25a. Also, because there is only 


{When m = n (as in this case), H(s) can also be realized in another way by recognizing that 


2 
A(s)=1- —— 
(s) s+7 


We now realize H(s) as a parallel combination of two transfer functions, as indicated by the above 
equation. 
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Y¥(s) 


F(s) F(s) 


(a) (b) 


Fig. 6.25 Realization of 7 


one signal to be summed at the output summer, the output summer is omitted. The 
realization in Fig. 6.25a is redrawn in a more convenient form, as illustrated in Fig. 6.25b. 
(d) 
4s + 28 
s?+6s4+5 
This is a second-order system with bo = 28, bı = 4, bz = 0, ao = 5, a1 = 6. 


Figure 6.26 shows a realization with two feedback connections and two feedforward 
connections. E 


H(s) = 


Fig. 6.26 Realization of ts. 


A Exercise E6.9 
Realize the transfer function 


2s 


H(s) = ———> 
(s) s2 + 6s + 25 


v 


6.6-2 Cascade and Parallel Realizations 


An nth-order transfer function H (s) can be expressed as a product or a sum of 
n first-order transfer functions. Accordingly, we can also realize H (s) as a cascade 
(series) or parallel form of these n first-order transfer functions. Consider, for 
instance, the transfer function in part (d) of the last example: l 
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4s + 28 
H(s) = =—— 
(s) s? +6s +5 
We can express H (s) as 
4s + 28 4s + 28 1 
Fg ee ee Ea A y a 6.76 
(s) (s +1)(s +5) =5 G) ( a) 
D 
Hı (8) H2(8) 


We can also express H (s) as a sum of partial fractions as 


Hove 4s+28 6 2 
~ (s+1)(s+5) s+1 8+5 


Hs(s)  Ha(s) 


(6.76b) 


Equation (6.76) gives us the option of realizing H (s) as a cascade of Hy(s) and 
Ho(s), as shown in Fig. 6.27a, or a parallel of H3(s) and H4(s), as depicted in 
Fig. 6.27b. Each of the first-order transfer functions in Figs. 6.27a or 6.27b can be 
realized by using a single integrator, as discussed in Example 6.18. 


Y (s) F(s) Y (s) 


(a) (b) 


Fig. 6.27 Realization of j#ft?%5 : (a) cascade form (b) parallel form. 


We have presented here three forms of realization (canonical, cascade, and 
parallel). The second canonical realization is developed in Appendix 6.1. However, 
this discussion by no means exhausts all the possibilities. Moreover, in the cascade 
form, there are different ways of grouping the factors in the numerator and the 
denominator of H (s). Accordingly, several cascade forms are possible. 

From a practical viewpoint, parallel and cascade forms are preferable because 
parallel and certain cascade forms are numerically less sensitive than canonical forms 
to small parameter variations in the system. Qualitatively, this difference can be 
explained by the fact that in a canonical realization all the coefficients interact with 
each other, and a change in any coefficient will be magnified through its repeated 
influence from feedback and feedforward connections. In a parallel realization, in 
contrast, the change in a coefficient will affect only a localized segment; the case 
with a cascade realization is similar. 

In the above examples of cascade and parallel realization, we have separated 
H (s) into first-order factors. For H (s) of higher orders, we could group H (s) into 
factors, not all of which are necessarily of the first order. For example, if H (s) is 
a third-order transfer function, we could realize this function as a cascade (or a 
parallel) combination of a first-order and a second-order factor. 
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Realization of Complex Conjugate Poles 


The complex poles in H(s) should be realized as a second-order (quadratic) 
factor because we cannot implement multiplication by complex numbers. Consider 
for example, 


10s + 50 
Heys (s + 3)(s? + 4s + 13) 
E 10s +50 
© (8 +38 +2- 43)(6 +2433) 
2 a Akija 1—42 


s+3 s+2-j3 84+24+53 

We cannot realize first-order transfer functions individually with the poles —2 + j3 
because they require multiplication by complex numbers in the feedback and the 
feedforward paths. Therefore, we need to combine the conjugate poles and realize 


them as a second-order transfer function.} In the present case, we can express H (s) 
as 


10 s+5 
H = ee, 
(s) (53) (i) (Seta 
2 2s — 8 


s+3 s2+4s+13 ee) 


Now we can realize H (s) in cascade form using Eq. (6.77a) or in parallel for: ; 
Eq. (6.77b). ) P m using 


Realization of Repeated Poles 

, When repeated poles occur, the procedure for canonical and cascade realization 
is exactly the same as above. In parallel realization, however, the procedure requires 
a special precaution, as explained in Example 6.19 below. 


E Example 6.19 
Determine the parallel realization of 


7s? + 37s +51 
(s + 2)(s + 3)? 
fn Ee 
s+2  8s+3 (s+3)? 

This third-order trans i i i 
But if we try to realize ay ieee ee epee ye rae Ras 
integrators because one of the terms is second-order. This difficulty can be avoided by 
observing that the terms 1/(s + 3) and 1/(s + 3)? can be realized with a cascade of two 
subsystems, each having a transfer function 1 /(s + 3), as shown in Fig. 6.28. Each of the 
three first-order transfer functions in Fig. 6.28 may now be realized as in Fig. 6.23. W 
A Exercise E6.10 

Find a canonical, a cascade, and a parallel realization of 


+3 st+3 i 
A(s = eS APUTA 
(s) s? +7s +10 (=) (<3) X 


TIt is possible to realize complex, conjugate poles indirectly by using a cascade of two first-order 
transfer functions. A transfer function with poles —a + jb can be realized by using a cascade of 
two identical first-order transfer functions, each having a pole at —a. (See Prob. 6.6-7.) 


H(s)= 
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Fig. 6.28 Parallel realization of Bie 


6.6-3 System Realization Using Operational Amplifiers 


In this section, we discuss practical implementation of the realizations described 
in the previous subsection. Earlier we saw that the basic elements required for the 
synthesis of an LTIC system (or a given transfer function) are (scalar) multipli- 
ers, integrators, and summers (or adders). All these elements can be realized by 
operational amplifier (op amp) circuits, as explained below. 


Fig. 6.29 A basic inverting configuration op amp circuit. 


Operational Amplifier Circuits 


Figure 6.29 shows an op amp circuit in the frequency domain (the transformed 
circuit). Because the input impedance of the op amp is infinite (very high), all of 
the current I(s) flows in the feedback path, as illustrated in Fig. 6.29. Moreover 
Vz(s), the voltage at the input of the op amp, is zero (very small) because of the 
infinite (very large) gain of the op amp. Therefore, for all practical purposes, 


Y (s) = -1 (s)Z p(s) 


Moreover, because vz % 0, 
F(s) 
I — 


Substitution of the second equation in the first yields 


_ _ 23(s) 
Y(s)=—- Z(s) F(s) 
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By properly choosing Z (s) and Z f(s) 
as the following development shows. 


6.30a), then Z;(s) = Rf, Z(s) = R, and 


a 


423 
Therefore, the op amp circuit in Fig. 6.29 has the transfer function 
2Z4(s) 
H(s) = -225 
(s) Zi) (6.78) 


, we can obtain a variety of transfer functions, 


(a) 


= k= Fc 


(b) 
Fig. 6.30 (a) Op amp inverting amplifier (b) integrator. 


The Scalar Multiplier 


If we use a resistor R f in the feedback and a resistor R at the input (Fig. 


H(s) = -4 (6.79a) 


The system acts as a scalar multiplier (or an amplifier) with a negative gain REA 
positive gain can be obtained by using two such multip 
a single noninverting amplifier, as depicted in Fig. 6.16c. Figure 6.30a also shows 
the compact symbol used in circuit diagrams for a scalar multiplier. 


. : R f 
liers in cascade or by using 


The Integrator 


If we use a capacitor C in the feedback and a resistor R at the input (Fig. 


6.30b), then Zs(s) = 1/Cs, Z(s) = R, and 
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F (s) 

F, (s) - Y(s) 

F (sje 
= wR 
Y(s) = Dk Fs) B= oR 

(a) (b) 
Fig. 6.31 Op amp summing and amplifying circuit. 
1 1 

H(s)={- = l- 6.79b 
= (-z)3 (6.790) 


The system acts as an ideal integrator with a gain —1/RC. Figure 6.30b also shows 
the compact symbol used in circuit diagrams for an integrator. 


The Summer 

Consider now the circuit in Fig. 6.31a with r inputs Fi(s), Fo(s),..., Fr(s). As 
usual, the input voltage V,(s) œ 0 because the gain of op amp — oo. Moreover, the 
current going into the op amp is very small (~ 0) because the input impedance — oo. 
Therefore, the total current in the feedback resistor Ry is I1(s) + Io(s)+---+I,(s). 
Moreover, because V;(s) = 0, 


Ij(s) = Zyn) j= 2a; 
Also j 
Y (s) = —Ry [h(s) + I2(s) +: + Tr(8)] 
= = [REF (6) + BPs) + + EFC) 
= kıFı(s) + k2F2(8) oa Sa k,F,(s) (6.80) 
where 
IE 
k; = R; 


Clearly, the circuit in Fig. 6.31 serves a summer and an amplifier with any desired 
gain for each of the input signals. Figure 6.31b shows the compact symbol used in 
circuit diagrams for a summer with r inputs. 


a Example 6.20 
Using op amp circuits, realize the canonical form of the transfer function 


2s8+5 
H(s) = aF 4s +10 
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Fig. 6.32 Op amp realization of a second-order transfer function sts 


The basic canonical realization is shown in Fig. 6.32a. Signals at various points are 
also indicated in the realization. Op amp elements (multipliers, integrators, and summers) 
change the polarity of the output signals. To incorporate this fact, we modify the canonical 
realization in Fig. 6.32a to that depicted in Fig. 6.32b. In Fig. 6.32a, the successive outputs 
of the summer and the integrators are s?X(s), sX(s), and X(s) respectively. Because 
of polarity reversals in op amp circuits, these outputs are —s?X(s), sX(s), and —X(s) 
respectively in Fig. 6.32b. This polarity reversal requires corresponding modifications in 
the signs of feedback and feedforward gains. According to Fig. 6.32a 


s°X(s) = F(s) — 4sX(s) — 10X(s) 
Therefore 
—8? X (s) = —F(s) + 4sX(s) + 10X (8) 
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©) 


Fig. 6.33 Op amp circuits for exercise E6.11. 


Because the summer gains are always negative (see Fig. 6.31b), we rewrite the above 
equation as 
—8°X (s) = —1[F(8)] — 4[-sX(s)] - 10[—X(s)] 


Figure 6.32b shows the implementation of this equation. The hardware realization appears 
in Fig. 6.32c. Both integrators have a unity gain which requires RC = 1. We have used 
R=100 kQ and C = 104F. The gain of 10 in the outer feedback path is obtained in 
the summer by choosing the feedback resistor of the summer to be 100 kQ and an input 
resistor of 10 kQ. Similarly, the gain of 4 in the inner feedback path is obtained by using 
the corresponding input resistor of 25 kN. The gains of 2 and 5, required in the feedforward 
connections, are obtained by using a feedback resistor of 100 kQ and input resistors of 50 
kQ and 20 kf respectively. 

The op amp realization in Fig. 6.32 is not necessarily the one that uses the fewest 
op amps. It is possible to avoid the two inverting op amps (with gain —1) in Fig. 6.32 
by adding signal sX (s) to the input and output summers directly, using the noninverting 
amplifier configuration in Fig. 6.16. There are also circuits (such as Sallen-Key) which 
realize a first- or second-order transfer function using only one op amp. 


A Exercise E6.11 ee 
Show that the transfer functions of the op amp circuits in Figs. 6.33a and 6.33b are Hı (s) 
and H2(s), respectively, where 


Hy(s) = SE ( = ) a 1 


R s+a = RC; 

C (stb 1 1 

a SUS ee ee 
eae oF (a) = RC RG Y 


6.7 Application to Feedback and Controls 


Generally, systems are designed to produce a desired output y(t) for a given 
input f(t). Using the given performance criteria, we can design a system shown in 
Fig. 6.34a. Ideally, such an open-loop system should yield the desired output. tn 
practice, however, the system characteristics change with time, as a result of aging 
or replacement of some components, or because of changes in the environment in 
which the system is operating. Hence, for a given input, the output of the system 
will also change with time. This condition is clearly undesirable in precision systems. 
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A possible solution to this problem is to apply an input that is not a predeter- 
mined function of time, but which will change to counteract the effects of changing 
system characteristics and the environment. In short, we must provide a correction” 
at the system input to account for the undesired changes mentioned above. But 
these changes are generally unpredictable, and it is difficult to program appropriate 
corrections to the input. However, the difference between the actual output and the 
desired output clearly indicates the suitable correction to be applied to the system 
input. Hence, we could make the input f (t) proportional to the desired output, and 
feed back the actual output y(t) to the input for comparison. The difference acts 
as the corrected input to the system. The input to the system is therefore continu- 
ously adjusted to obtain the desired response. Such systems (Fig. 6.34b) are called 
feedback or closed-loop systems for obvious reasons. We observe thousands of 
examples of feedback systems around us in everyday life. Most social, economical, 
educational, and political processes are, in fact, feedback processes. The human 
body itself is a fine example of a feedback system; almost all of our actions are 
the product of feedback mechanism. The human sensors such as eyes, ears, nose, 
tongue, and touch are continuously monitoring the state of our system. This infor- 
mation is fed back to the brain, which acts as a controller to apply corrected inputs 
through our motor mechanisms and thus accomplish the desired objective. 


(a) 


(b) 


Fig. 6.34 Open-loop and closed-loop (feedback) systems. 


Consider the process of driving an automobile. Our senses are continuously 
feeding the information to the brain. Eyes report seeing a child on the road. The 
brain will immediately apply input to the arms to steer the car away from the child. 
There is a red light ahead. Again the brain will apply the input to the legs to brake 
the car. Suddenly, ears report an ambulance siren; the brain will apply corrective 
input to steer the car off the street temporarily. A foul smell is reported by the 
nose. The brain will again take measures to speed away the car from the spot. In 
this example, the child, the red light, the ambulance siren, and the foul smell are 
unpredictable changes in the environment (fed back to the input by our senses). 
Despite these unpredictable changes in the environment, the process of reaching 
the destination is completed because of feedback. The foregoing is an example of 
multiple variable feedback. 

A feedback system can address the problems arising because of unwanted dis- 
turbances such as random-noise signals in electronic systems, a gust of wind affecting 
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a tracking antenna, a meteorite hitting a spacecraft, and the rolling motion of an- 
tiaircraft gun platforms mounted on ships or moving tanks. Feedback may also be 
used to reduce nonlinearities in a system, or control its rise time (or bandwidth). 
Feedback is used to achieve, with a given system, the desired objective within a 
given tolerance, despite partial ignorance of the system and the environment. A 
feedback system, thus, has an ability for supervision and self-correction in the face 
of changes in the system parameters, and external disturbances (change in the en- 
vironment). Consider the feedback amplifier in Fig. 6.35. Let the forward amplifier 
gain G = 10,000. One hundredth of the output is fed back to the input (H = 0.01). 
The gain T of the feedback amplifier is obtained by [see Eq. ((6.69)} 


pa € _ 10,000 
~14+GH ~~ 1+4100 


Suppose that because of aging or replacement of some transistors, the gain G of 
the forward amplifier changes from 10,000 to 20,000. The new gain of the feedback 


amplifier is given by 


= 99.01 


r- —G_ _ 20,000 

 14+GH 14200 

Observe that 100% variation in the forward gain G causes only 0.5% variation in 
the feedback amplifier gain T. 


= 99.5 


f(t) 


Fig. 6.35 Effects of positive and negative feedback. 


Now, consider what happens when we add (instead of subtract) the signal fed 
back to the input. Such addition means the sign on the feedback connection is + 
instead of — (which is same as changing the sign of H in Fig. 6.35). Consequently 


gis 
“AGH 


If we let G = 10, 000 as before and H = 0.9 x 1074 , then 


10, 000 
~ 1—0.9(104)(10~4) 


Suppose that because of aging or replacement of some transistors, the gain of the 
forward amplifier changes to 11,000. The new gain of the feedback amplifier is 


= 100, 000 


T= 11, 000 
~ 1 —0.9(11, 000)(10-4) 
Observe that in this case, mere 10% increase in the forward gain G caused 1000% 
increase in the gain T (from 100,000 to 1,100,000). Clearly, the amplifier is very 
sensitive to parameter variations. This behavior is exactly opposite of what was 
observed earlier, when the signal fed back was subtracted from the input. 


= 1,100, 000 
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6.7-1 Analysis of a Simple Control System 


PE oie pe ate an automatic position control system, which can be 
ontrol the angular position of a heavy obi cki 
o c y object (e.g., a tracking ant 
an anti-aircraft gun mount, or the iti i in i pag 
; Position of a ship). The input 6; is th desi 
angular position of the object, which can b SR gener 
it ; e set at any given value. Th 
angular position 8, of the ob ject (the out i i Hee 
ngulay put) is measured by a potentiometer wh 
wiper is mounted on the output shaft The diff aa 
; between the out 
the input 6; is amplified; the i aie ieee 
i ; amplified output, which is pro ortional i 
applied to the motor input. If 8, — 6; = i eda Goa 
: c $ o ~ ĝi = 0 (the output being equal to the desi 
ae there is no input to the motor, and the motor stops. But if 6, 4 6; pie 
ny i OER input to the motor, which will turn the shaft until 05 = 6, It is 
ent that by setting the input potentiometer at a desired Position in this syster 
we a control the angular position of a heavy remote object. 
5 eas nia a this system is shown in Fig. 6.36b. The amplifier gain is 
; is adjustable. Let the motor (with load) tr i 
ansfer function that relat 
pa ote angle @, to the motor input voltage be G(s) [see Eq. (1.65)] This 
n ack arrangement is identical to that in Fig. 6.18d with H(s)=1. Hence T(s) 
e (closed-loop) system transfer function relating the output 9 to the input 6; is 
t 


From this equation, we shall į i 
ition, investigate the behavior of the automati iti 
control system in Fig. 6.36a for a step and a ramp input. cen 


Step Input 


mera a change the angular position of the object instantaneously, we 
y a step input. We may then want to k h 
takes to position itself at the desi pa rai ae 
sired angle, whether it reaches the desi 
t : angle, esired angle, 
and whether it reaches the desired position smoothly (monotonically) or Sacillafec 


oe the output S(t) when the input O:(t) = u(t). A step input implies the 
antaneous change in the angle. This input would be one of the most difficult 
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t — 


Fig. 6.36 (a) An automatic position control system (b) its block diagram (c) the unit 
step response (d) the unit ramp response. 
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to follow; if the system can perform well for this input, it is likely to give a good 
account of itself under most other expected situations. This is the reason why we, 
test control systems for a step input. 

For the step input 6,(t) = u(t), O:(s) = 1/s and 


KG(s) 
s{1+ KG(s)] 


Let the motor (with load) transfer function relating the load angle folt) to the 
motor input voltage be G(s) = EES [see Eq. (1.65)]. This yields 


@,(s) = =7(s) = 


K_] s(s2 K 
s [2 + y] s(s? + 8s + K) 


Let us investigate the system behavior for three different values of gain K. 


K 
Əs) = -E n 


1. K=7 


Əs(s) = 7 = if 
aN ~ 36s? +85+7)  s(841)(847) 
T 
=-1 é, 


and 
Bo(t) = (1 — ge + te~) u(t) 


This response, illustrated in Fig. 6.36c, appears rather sluggish. To speed up the 
response let us increase the gain to, say, 80. 


2. K=80 
80 80 
9 = =y = — 
o(s) s(s? +8s +80)  s(s +4 -— j8)(s +4 + j8) 
_1 MB 153° P ¥5 —7153° 
s s+4-j8 s+44 58 
and 


mee [2 + Lett cos (8t + 153°)| u(t) 


This response, depicted in Fig. 6.36c, is certainly faster than in the earlier case 
(K = 7), but unfortunately the improvement is achieved at the cost of ringing 
(oscillations) with high overshoot. In the present case the percent overshoot PO 
is 21%. The response reaches its peak value at peak time tp = 0.393 seconds. 
The rise time, defined as the time required for the response to rise form 10% to 
90% of its steady-state value, indicates the speed of response.} In the present case 
tr = 0.175 seconds. The steady-state value of the response is unity so that the 
steady-state error is zero. Theoretically it takes infinite time for the response to 


eee 
{Delay time ta, defined as the time required for the response to reach 50% of its steady-state 
value, is another indication of speed. For the present case, tg = 0.141 seconds 
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reach the desired value of unity. In practice, however, we may consider the response 
to have settled to the final value if it closely approaches the final value. A widely 
accepted measure of closeness is within 2% of the final value. The time required 
for the response to reach and stay within 2% of the final value is called the settling 
time ts.t In Fig. 6.36c, we find ts = 1 second. A good system has a small overshoot, 
a small value of t, and t, and a small steady-state error. 

A large overshoot, as in the present case, may be unacceptable in many appli- 
cations. Let us try to determine K (the gain) which yields fastest response without 
oscillations. Complex characteristic roots lead to oscillations; to avoid oscillations, 
the characteristic roots should be real. In the present case the characteristic poly- 
nomial is s?+8s +K. For K > 16, the characteristic roots are complex; for K < 16, 
the roots are real. The fastest response without oscillations is obtained by choosing 
K = 16. We now consider this case. 


3. K=16 
16 16 
tole) = a(s? +8s +16) s(s+4)? 
1 1 4 
Sa oe (s +4)? 
and 


bolt) = [1 — (4t + 1)e7*] u(t) 


This response also appears in Fig. 6.36c. The system with K > 16 is said to be 
underdamped (oscillatory response), whereas the system with K < 16 is said to 
be overdamped. For K = 16, the system is said to be critically damped. 

There is a trade-off between undesirable overshoot and rise time. Reducing 
overshoots leads to higher rise time (sluggish system). In practice, a small overshoot 
may be acceptable, which is still faster than the critical damping. Note that percent 
overshoot PO and peak time tp are meaningless for the overdamped or critically 
damped cases. In addition to adjusting gain K, we may need to augment the system 
with some type of compensator if the specifications on overshoot and the speed of 
response are too stringent. 


Ramp Input 


If the antiaircraft gun in Fig. 6.36a is tracking an enemy plane moving with a 
uniform velocity, the gun-position angle must increase linearly with t. Hence, the 
input in this case is a ramp; that is, 6;(t) = tu(t). Let is find the response of the 
system to this input when K = 80. In this case, ©;(s) = gz, and 


80 01, 1 Ols- 2) 
Oo) raer e ot PE Re BO 


Use of Table 6.1 yields 


y(t) = |-O.1+¢4+ a cos (8t + 36.87°)| u(t) 


{Typical percentage values used are 2% to 5% for ts. 


a 
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This response, sketched in Fig. 6.36d, shows that there is a steady-state error e, = 
0.1 radian. In many cases such a small steady-state error may be tolerable. If; 
however, a zero steady-state error to a ramp input is required, this system in its 


present form is unsatisfactory. We must add some form of compensator to the 
system. 


© Computer Example C6.4 

Find the step response of the feedback system in Fig. 6.36b with G(s) = T if 
K =7, 16, and 80. Find the unit ramp response of this system for the case K = 80. 

In computer example C6.3, we have obtained the transfer functions of this feedback 
system. Here, we shall redo this part again in another way to illustrate the use of ‘conv’ 
command when the denominator of G(s) is made up of two factors Di(s) and Do(s), 
The command ‘conv’ multiplies Di(s) with Do (s) and gives the coefficients of the product 
Di(s)D2(s). To find the step and ramp response for a given value of K, we first create an 
m-file c64a.m as 

% (c64a.m) 

Gnum=[0 0 K];Gden=conv([0 1 0],[0 1 8]); 

Hnum=(0 0 1);Hden=[0 0 1}; 

[NumTF,DenTF]=feedback(Gnum,Gden,Hnum,Hden); 

step(NumTF,DenTF) 


To plot the step response (as in Fig. 6.36c), we create another file c64b.m as: 

K=7;c64a; hold on, 

K=16;c64a; K=80;c64a 

The unit ramp response of this system is the same as the unit step response of a 
system with transfer function T(s)/s. Hence, we can use the file c64a to find the ramp 
response. To plot the ramp response, for K = 80, we create c64c.m file as follows: 

K=80; c64a; 

NumTFr=NumTF; DenTFr=conv([0 1 0},DenTF); 

printsys(NumTFr,DenTFr); 

step(NumTFr,DenTFr) © 


Design Specifications 


The above discussion has given the reader some idea of the various specifications 
a control system might require. In general we may be required to design a control 
system to meet some or all of the following specifications: 


1. Transient Response 
(a) Specified overshoot to step input. 


(b) Specified rise time t, and /or delay time tg. 
(c) Specified settling time t,. 


D 


Steady-State Error 


Specified steady-state error to certain expected inputs such as step, ramp, 
or parabolic inputs. In control systems, the transient response is generally 
specified for the step input. The reason is that the step input represents a 
sudden jump discontinuity. Hence if a system has an acceptable transient 
response for step input, it is likely to have acceptable transient response for 
most of the practical inputs. Steady-state errors, however, must be specified 
for typical inputs of the system. For the given system one must determine what 
kind of input (step, ramp, etc) are likely to occur, and then specify acceptable 
steady-state requirements for these inputs. 
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3. Sensitivity 
The system should satisfy a specified sensitivity specifications to some system 
parameter variations, or to certain disturbances. Sensitivity analysis will not 
be considered here. 


6.7-2 Analysis of a Second-Order System 


The transient response depends upon the location of poles and zeros of the 
transfer function T(s). For a general case, however, there is no quick way of pre- 
dicting transient response parameters (PO, t,, ts) from the knowledge of poles and 
zeros of T(s). However, for a second-order system with no zeros, there is a direct re- 
lationship between the pole locations and the transient response. In such a case, the 
pole locations can be immediately determined from the knowledge of the transient 
parameter specifications. As we shall see, the study of the second-order system can 
be used to study many higher-order systems. For this reason we shall now study 
the behavior of a second-order system in detail. 


Fig. 6.37 Pole location of a second-order system. 


Let us consider a second-order transfer function T(s), given by 


2 
wn (6.81) 


Te) = g wns + we 


The poles of T(s) are -Cwn + jwn y1 -— ¢?, as depicted in Fig. 6.37. These are 
complex when the damping ratio ¢ < 1 (underdamped case), and are real for 
Ç > 1. Ç = 1 represents the critically damped and ¢ > 1, the overdamped case. 
Smaller ¢ means smaller damping, leading to higher overshoot and faster response. 
For the unit step input F(s) = 1/s, and 


YG) Se EM E 
8(82 + 2unstw2) 8 s%4 2Kuns+w2 


Use of Table 6.1 (pairs 1 and 10c) yields 


1 


y(t) = h- Vita 


e7 S98 sin(wn y1 — C2t + cos? C)| u(t) (6.82) 
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The nature of this response for the underdamped case (¢ < 1) is illustrated in 
Fig. 6.38. The response decays exponentially as e~S#nt, Hence, the time constant 
of response is 1/Çwn. It takes four time constants for an exponential to decay tô 
slightly less than 2% of its initial value. Hence, the settling iime t, is given by 


Steady-state 
Value 


a4 
1 : / Specified 
T ' Tolerance 
ty A i 
Fig. 6.38 Unit step response of a second-order system. 
P 4 
= (6.83) 


To determine the PO (percent overshoot), we find tp, the peak time where the peak 


overshoot occurs. At t = tp, dy/dt = 0. The straightforward solution of this 
equation yields 


T 
tp = — = 
P aaa 


Moreover, PO is given by 


ty) —1 aa 
PO = stp) 1 x 100% = 100e~$7/v 1-¢? (6.84) 


Figure 6.39 shows PO as a function of ¢. For a second-order system, the PO is 
directly related to the damping ratio ¢. 

We may now proceed to determine similar expressions for ¢, and tg. Unfor- 
tunately, these turn out to be transcendental equations. However, these equations 
can be solved on a computer. Results of these computation appear in Fig. 6.39. 


Although precise expressions for t- and tg cannot be found, useful approximations 
are 


 1- 0.41676 + 2.917¢2 1.1+0.125¢ + 0.469¢? 
tem DEERE pm ALONE HOMS gy 
n n 


436 6 Continuous-Time System Analysis Using the Laplace Transform 


PO 


Fig. 6.39 (a) Plots of PO, ts and t, as functions of damping ratio Ç. 


Clearly, for a second-order system the pole locations determine the transient 
behavior of the system. We observe that the closer the poles to the jw-axis, the 
smaller the value of ¢, and the larger the PO. Generally speaking, poles should 
not be too close to the jw-axis, a positioning which leaves too little safety margin 
for stability and makes the system sensitive to parameter variations. Hence it is 
generally desirable to have a larger value for ¢ (small PO). For a fast response it is 
desirable to have small values for tr, ts, ty and tg. 

This discussion shows that for a second-order system in Eq. 6.81, all the tran- 
sient parameters (PO, tr, ts, tp and tg ) are related to the pole location of T(s). 
From the point of view of the system design, it will be convenient to draw the 
contours representing different values of transient parameters in the s-plane. For 
instance, each radial line drawn from the origin in the s-plane represents a constant 
¢ line (see Fig. 6.37). Since the PO is directly related to ¢ (Fig. 6.39), each radial 
line also represents a line of constant PO, as depicted in Fig. 6.40. Similarly, each 
vertical line represents constant (w, (see Fig. 6.37). Because ts = 4/Cwn, the lines 
representing constant settling time are vertical lines, as shown in Fig. 6.40. This fig- 
ure also shows the contours for constant tp. These contours allows us to determine 
by inspection, the important transient characteristics (PO, t,, ts) of a second-order 
system from the knowledge of its pole locations. Moreover, if we are required to 
synthesize a second-order system to meet some given transient specifications, we 
can find the desired T(s) with the help of this figure. 

As an example consider the position control system in Fig. 6.36a. Let the 
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Fig. 6.40 Contours of second-order system pole location for constant PO, constant ts, 
and constant t» in s plane. 


transient specifications for this system be given as 


PO < 16%, tr < 0.5 seconds ts < 2 seconds (6.86) 


We delineate appropriate contours in Fig. 6.40 to meet the above specifications. The 
shaded region defined by these contours in Fig. 6.41 meets all the three requirements. 
Hence T(s) must be chosen so that both of its poles lie in the shaded region. The 
transfer function T(s) for the closed-loop system in Fig. 6.36a is given by 


OE KG(s) _ K 
1+KG(s) 3248s} K (6-87a) 


This shows that locations of the poles of T (s) can be adjusted by changing the gain 
K. We must choose the gain K so that the poles lie in the shaded region in F ig. 
6.41. The poles of T(s) are the roots of the characteristic equation 
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Fig. 6.41 Designing a second-order system to meet a given transient specifications. 


s7+8s+K =0 (6.87b) 


Hence the poles are 


sig=—4+ VI6- K (6.87c) 


The poles sı and sz (the roots of the characteristic equation) move along a a 
path in the s-plane as we vary K from 0 to oo. When K = 0, the poles are —8, a 
For K < 16, the poles are real and both poles move towards a value —4 as K 
varies from 0 to 16 (overdamping). For K = 16, both poles coincide at -4 feritical 
damping). For K > 16, the poles become complex with values —4 + : vK = 
(underdamping) Since the real part of the poles is —4 for all K > 16, p 5 aes 
the poles is vertical as illustrated in Fig. 6.41. One pole moves up as t = o se 
(its conjugate) moves down along the vertical line passing through -4 For 

label the values of K for several points along these paths, as depicted in Fig. i : 
Each of these paths represents a locus of a pole of T (s) or a locus of a root i t i 
characteristic equation of T(s) as K is varied from 0 to oo. For this reason this x 

of paths is called the root locus. The root locus gives us the information as i 
how the poles of the closed-loop transfer function T (s) move as the gain K -A a 

from 0 to oo. In our design problem, we must choose a value of K such tel 
poles of T (s) lie in the shaded region shown in Fig. 6.41. This figure ae i a 
system will meet the given specifications [Eq. (6.86)] for 25 < K < 64. For K = 64, 
for instance we have 


4 
PO = 16%, tr = 0.2 seconds, t= a 1 seconds (6.88) 
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Higher-order Systems 


Our discussion, so far, has been limited to second-order T(s) only. If T(s) has 
additional poles which are far away to the left of jw-axis, they have only a negligible 
effect on the transient behavior of the system. The reason is that the time constants 
of such poles are considerably smaller when compared to the time constant of the 
complex conjugate poles near the jw-axis. Consequently, the exponentials arising 
because of poles far away from the jw-axis die quickly compared to those arising 
because of poles located near the jw-axis. In addition, the coefficients of the former 
terms are much smaller than unity. Hence, they are also very small to begin with 
and decay rapidly. The poles near the jw-axis are called the dominant poles. A 
criterion commonly used is that any pole which is five times as far from the jw-axis 
as the dominant poles contributes negligibly to the step response, and the transient 
behavior of a higher-order system is often reduced to that of a second-order system. 
In addition, a closely placed pole-zero pair (called dipole), contributes negligibly 
to the transient behavior. For this reason, many of the pole-zero configurations in 
practice reduce to two or three poles with one or two zeros. Workers in the field have 
prepared charts for transient behavior of these systems for several such pole-zero 
combinations, which may be used to design most of the higher-order systems. 


y(t) 


Fig. 6.42 A feedback system with a variable gain K. 


6.7-3 Root Locus 


The example in Sec. 6.7-2 gives a good idea of the utility of root locus in 
design of control systems. Surprisingly, root locus can be sketched quickly using 
certain basic rules provided by W.R. Evans in 1948.t With the ready availability 
of computers, root locus can be produced easily. Nevertheless, understanding these 
rules can be a great help in developing the intuition needed for design. We shall 
present here the rules, but omit the proofs of some of them. 

We begin with a feedback system depicted in Fig. 6.42, which is identical to 
Fig. 6.18d, except for the explicit representation of a variable gain K. The system 
in Fig. 6.36a is a special case with H(s) = 1. For the system in Fig. 6.42, 


KG 
T(s) = EC) 
1+ KG(s)H(s) 
The characteristic equation of this system ist 
eee 
This procedure was developed as early as 1868 in Maxwell’s paper “On Governors”. 


tThis characteristic equation is also valid when the gain K is in the feedback path [lumped with 
H(s)] rather than in the forward path. The equation applies as long as the gain K is in the loop 
at any point. Hence, the root locus rules discussed here apply to all such cases. 


(6.89a) 
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1+ KG(s)H(s) =0 (6.89b) 


We shall consider the paths of the roots of 1 + KG(s)H(s) = 0 as K varies from 
0 to oo. When the loop is opened, the transfer function is KG(s)H(s). For this 
reason, we refer to KG(s)H(s) as the open-loop transfer function. The rules 
for sketching the root locus are as follows. 


1. Root loci begin (K = 0) at the open-loop poles and terminate on the open- 
loop zeros (K = œ). This fact means that the number of loci is exactly n, 
the order of the open-loop transfer function. Let G(s)H(s) = N(s)/D(s), 
where N(s) and D(s) are polynomials of powers m and n, respectively. Hence, 
1+ KG(s)H(s) = 0 implies D(s) + KN(s) = 0. Therefore, D(s) = 0 when 
K = 0. In this case, the roots are poles of G(s)H (s); that is, the open-loop 
poles. Similarly, when K — oo, D(s) + K.N(s) = 0 implies N(s) = 0. Hence, 
the roots are the open-loop zeros. For the system in Fig. 6.36a, the open-loop 
transfer function is K/s(s + 8). The open loop poles are 0 and —8 and the 
zeros (where K/s(s + 8) = 0 are both oo. We can verify from Fig. 6.41 that 
the root loci do begin at 0 and —8 and terminate at oo. 


2. A real axis segment is a part of the root locus if the sum of the real axis poles 
and zeros of G(s)H(s) that lie to the right of the segment is odd. Moreover, 
the root loci are symmetric about real axis. 


We can readily verify in Fig. 6.41 that the real axis segment to the right of —8 
has only one pole (and no zeros). Hence, this segment is a part of the root 
locus. 


3. The n—m root loci terminate at oo at angles kr/(n — m) for k = 1, 3, 5,.... 


Note that, according to rule 1, m loci terminate on the open loop zeros, and 
the remaining n — m loci terminate at oo according to this rule. In Fig. 6.41, 
we verify that n — m = 2 loci terminate at oo at angles kr/2 for k = 1 and 3. 


Now we shall make an interesting observation. If a transfer function G(s) has 
m (finite) zeros and n poles, then lim,_,.. G(s) = s/s” = 1/s""™. Hence, 
G(s) has n — m zeros at oo. This fact shows that although G(s) has only m 
finite zeros, there are additional n — m zeros at oo. According to rule 1, m loci 
terminate on m finite zeros, and according to this rule the remaining n — m 
loci terminate at oo, which are also zeros of G(s). This result means all loci 
begin on open loop poles and terminate on open loop zeros. 


4. The centroid of the asymptotes (point where the asymptotes converge) of the 
(n — m) loci that terminate at oo is 


ga Pit pats: + Pa) — (at zat + em) 
(n =m) 


where pi, P2,- .., Pn are the poles and 2, 22, ..., 2m are the zeros, respectively, 
of the open-loop transfer function. 
Figure 6.41 verifies that the centroid of the loci is [(—8 + 0) — 0]/2 = ~4. 


5. There are additional rules, which allow us to compute the points where the 


loci intersect and where they cross the jw axis to enter in the right-half plane. 
These rules allow us to draw a quick and rough sketch of the root loci. But 
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the ready availability of computers and programs makes it much easier to draw 


actual loci. Th i i i 
ae aan e first four rules are still very helpful for a quick sketching of 


: Understanding these rules can be helpful in design of control systems as demon- 
strated later. They are an aid in determining what modifications should be made 


(or what kind of compensator to add) 
l to the open loop transfer fı ion i 
to meet given design specifications. j e iii 


E Example 6.21 


Using the four rules of the root loci, sketch 


the i 
E aA root locus for a system with open 


KG(s)H(s) = ——*_ 
(s) (8) s(s + 2)(s + 4) 
1. Rule 1: For this G(s)H(s = i i i 
anak Cone iG h a a parcial ay are three root loci, which begin at 
2. Rule 2: There are odd numbers of 
and —2 < 8 < 0. Hence, these se 
the entire real axis in the left- 
a part of the root locus. 


3. Rule 3: n — m = 3. Hence, (all) the three loci terminate at oo along asymptotes at 
angles k7/3 for k = 1, 3 and 5. Thus, the asymptote angles are 60°, 120° and 180° 
4. Rule 4: The centroid (where all the three asymptotes converge) is (0— 2—4)/3 = -9, 
We draw three asymptotes starting at —2 at angles 60°, 120° and 180°, as shown in 
Fig. 6.43. This information suffices to give an idea about the root locus. The oa 
root loci are also shown in Fig. 6.43. Two of the asymptotes cross over to the RHP 
behavior which shows that for some range of K, the system becomes unstable. E 


poles to the right of the real axis segment s < —4, 
gments are the part of root locus. In other words, 
half plane, except the segment between —2 and —4, is 


© Computer Example C6.5 
Solve Example 6.21 using MATLAB. 
The MATLAB commands to find the root locus for this case are: 


num=[0 0 0 1]; 


den=conv(conv([1 0],[1 2]),[1 4]); 
rlocus(num,den),grid ©) 


6.7-4 Steady-State Errors 


Steady-state specifications im 
transfer function T(s). The ste 
sired output [reference f(t)] and 
and 


pose additional constraints on the closed-loop 
ady-state error is the difference between the de- 
the actual output y(t). Thus e(t) = f(t) - y(t), 


E(s) = F(s) — Y (s) 
A Y(s) 
=F ji- 73 
= F(s)[1 — T(s)] (6.90) 
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— oe 
2 s(s + 2)(s +4) oa 


Fig. 6.43 A third-order feedback system and its root locus. 


The steady-state error ess is the value of e(t) as t oo. This value can be readily 
obtained from the final-value theorem [Eq. (6.68)]: 


ess = lim sE(s) = lim sF(s)[1 — T(s)] (6.91) 
3s—0 s—0 
1. For the unit step input, the steady-state error es is given by 
es = lim (1 — T(s)] = 1-T(0) (6.92) 
8 


If T(0) = 1, the steady-state error to unit-step input is zero. SO 
2. For a unit ramp input, F(s) = 1/s? and er, the steady-state error, is given by 


ree et HU 
esi =o! 
s—0 s 


(6.93) 


If T(0) # 1, ey = 00. Hence for a finite steady-state error to ramp input, a necessary 
condition is T(O) = 1, implying zero steady-state error to step input. Assuming 
T(0) = 1 and applying L’Hopital’s rule to Eq. (6.93), we have 


er = lim [—T(s)] = —T(0) (6.94) 


3. Using a similar argument, we can show that for a unit parabolic input t = 
(t2/2)u(t), and F(s) = 1/s? and ep, the steady state error is 
T(0) 


=o (6.95) 
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F(t) e(t) 


Fig. 6.44 A unity feedback system with variable gain K. 


assuming T(0) = 1 and T(0) =0. 
Many systems in practice have unity feedback, as depicted in Fig. 6.44. In 
such a case, the steady-state error analysis is greatly simplified. Let us define 


positional error constant K p velocity error constant K,, and acceleration 
error constant K, as 


Kp = lim[KG(s)],  K,= lim s[KG(s)],  Ka= lim s?[K G(s)] (6.96) 


Because T(s) = KG(s)/1+ KG(s), from Eq. (6.90), we obtain 


1 
E(s) = F 
©) = Kaw O 
The steady-state errors are given by 
1/s 1 1 


= ia jo tl Sh 6.97 
ert, “T+ KG(s) 1 + lims—o [KG(s)]  1+Kp S87) 


Se ee ac : 4l (6.97b) 
"890 1+KG(s) limsso s[KG(s)] K, 
1/s3 1 1 
= -e = aMi 6.97 
o> im a KG(s) limao s*(KG(s)] Ka G 
For the system in Fig. 6.36a, 
1 
Gays s(s + 8) 
Hence, from Eq. (6.96) 
K 
Kp = 00, Rye K,=0 (6.98) 
Substitution of these values in Eq. (6.97) yields 
8 
es = 0, e= €p = CO 


A system where G(s) has one pole at the origin (as the present case) is designated 
as type 1 system. Such a system can track position of an object with zero error 
(es = 0), and yields a constant error in tracking an object moving with constant 


velocity (e, = a constant). But the type 1 system is not suitable for tracking a 
constant acceleration object. 
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If G(s) has no poles at the origin, then K, is finite and K, = Ka = 0. Thus, 
for 


(s + 2) 
(s +1)(s + 10) 


Kp = K/5 and K, = Ka = 0. Hence, es = 5/(5+ K) and e, = ep = œ. Such 
systems are designated as type 0 systems. These systems have finite e,, but infinite 
er and ep. These systems may be acceptable for step inputs (position control), but 
not for ramp or parabolic inputs (tracking velocity or acceleration). 

If G(s) has two poles at the origin, the system is designated as type 2 system. 
In this case Kp = K, = oo, and Kg = finite. Hence, es = e, = 0 and ep is finite. 

In general, if G(s) has q poles at the origin, it is a type q system. Clearly, 
for a unity feedback system, increasing the number of poles at the origin in G(s) 
improves the steady-state performance. However, this procedure increases n and 
reduces the magnitude of ø, the centroid of the root locus asymptotes. This shifts 
the root locus towards the jw-axis with consequent deterioration in the transient 
performance and the system stability. 

It should be remembered that the results in Eqs. (6.96) and (6.97) apply only 
to unity feedback systems (Fig. 6.44). Steady-state error specifications in this case 
are translated in terms of constraints on the open-loop transfer function K G(s). 
In contrast, the results in Eqs. (6.92) through (6.95) apply to unity as well as 
nonunity feedback systems, and are more general. Steady-state-error specifications 
in this case are translated in terms of constraints on the closed-loop transfer function 
T(s). 

The unity feedback system in Fig. 6.36a is type 1 system. We have designed 
this system earlier to meet the following transient specifications: 


G(s) = 


PO = 16%, tr < 0.5, ts <2 (6.99) 


Let us further specify that the system meet the following steady-state specifications: 
e, = 0, er < 0.15 


For this case, we already found es = 0, e = 8/K and ep = 00 {see Eq. (6.98)]. But 
we require ep < 0.15. Therefore 


> <0.15 = K > 53.34 (6.100) 


Turning to Fig. 6.41, we note that the poles of T (s) lie in the acceptable region 
to meet transient. specifications (25 < K < 64). Equation (6.100) shows that we 
must use K > 53.34 to meet steady-state performance. Therefore to meet both 
the transient and the steady-state specifications we must set the gain in the range 
53.34 < K < 64. The smallest steady-state error for a ramp input is obtained for 


K = 64. For this case, 
8 8 
=—=-—=012 
er K 64 0.125 
Thus if the system is to meet the transient performance in Eq. (6.99), the minimum 
er = 0.125. We can do no better. In case we are required to have ep < 0.125 
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fO Compensator ü 
(a) 
s plane 
(5) +O 
G(s) = 7 = s whereas 1 B= R +R, 
ae RCT” RRC 


Fig. 6.45 A lead compensator. 


while maintaining the sam P ’ 
e transient erformance we will have to use some kind 
of compensation, 


6.7-5 Compensation 


l The synthesis problem for the position control system in Fig. 6.36a is a ver 
simple example where the transient and steady-state specifications could be met by 
simple adjustment of gain K. In many cases, it may be impossible to meet bath 
sets of specification (transient and steady state ) by simple adjustment of the gain 
K. We may be able to satisfy one set of specifications or the other but not both 
Consider again the system in Fig. 6.36a, with the following specifications: l 


PO = 16% tr < 0.5 te <2 es =0 er < 0.05 


To meet the steady-state specification we must have 


= $0.05 => K > 160 

But Fig. 6.41 indicates that for K > 64, the poles of T(s) 
acceptable for transient performance. Clearly, 
the steady-state specification but not both. I 
of compensation, which will modify the root | 
little familiarity with root-locus techniques giv 
choose a proper compensator transfer functio 
the root locus to the left will accomplish the 
compensator of transfer function G(s) 


move out of the region 

we can meet either the transient or 
n such case we must add some kind 
ocus to meet all the specifications. A 
es the insight and judgment needed to 
n. Figure 6.41 indicates that shifting 
desired performance. We can place a 
in series with G(s) (Fig. 6.45a) and select 
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Fig. 6.46 Root locus of the system in Fig. 6.36a after lead compensation. 


the poles and zeros of G.(s) in such a way as to shift the centroid of the root ear 
to the left. If G.(s) has a single pole and a single zero, then choosing the m e 
farther to the left of the zero would shift the centroid to the left according to the 
fourth rule of the root locus. Thus, we use 


_ sta 

~ s+B A 
i tor, which is readily realize 

Such a compensator is called the lead compensator, ; 1 

using a simple RC circuit shown in Fig. 6.45b. We have a wide choice for values of 

a and 8. To simplify design, let us choose a = 8 and 2 = 30. This choice yields 


s+8 K = K 
Gola) Cla) 5.20.) aa 8): ate 80) 
To simplify our discussion we deliberately chose a = 8 to cancel the pole of G(s). 
In practice, we do not necessarily have to cancel the pole of G(s). In the present 
situation, @ = (—30 + 0)/2 = 15, and the new root locus appears in Fig. 6.46. 
Observe that the situation has improved considerably by shifting the centroid from 
—4 to —15. If we select K = 600, we have 


Gels) B>a 


600 


T(s) Ss+30) 600 
s= 600. T 2 
1+ F30) s* + 30s + 600 


Vv = = 4.5 = 0.61 and 
i = V600 = 24.5. Also Cw, = 15. Hence, ¢ = 15/2 
: ek Zs = 0.266. From Eq. (6.84), we find PO=8.9%. Moreover, fom 
Fig. 6.39 [or Eq. (6.85)], for ¢ = 0.61, we find wntr = 1.83 so that t, = 1.83/24.5 = 
0.0747. We also have 

K _ 600 


= =o = — s >e,=0 er = 
Kp = œ Ky = 35 30 20 Es r 


The system meets all the specifications and more. 
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We shall now discuss a compensation which is primarily used to improve the 
steady-state performance. For unity feedback systems, the steady-state performance 
of a system is improved by placing an integrator in the forward path of Gfs) 
This procedure increases the system type, thus increasing K pı Ky, Ka, etc. The 
compensator in this case is G,(s) = 1/s. 

In this scheme the compensator is an ideal integrator. Hence, this scheme is 
known as integral control. Design of an ideal integrator necessitates elaborate and 
expensive equipment. Hence, such a compensator is used where cost considerations 
are not very important. For example, integrating gyroscopes are used for this 
purpose in aircraft. In most cases a lag compensator (described below) which 


closely approximates the a behavior of an integrator is used. A lag compensator 
transfer function is given by 


s+a 
Gol) = aes a>p 
and F 
G,.(0) = — 
(0) z 


A lag compensator can be readily realized using a simple RC circuit depicted in 
Fig. 6.47. For a unity feedback system, addition of a compensator G.(s) causes 
all the error constants K p Ky, Ka, etc., to be multiplied by G.(0). Thus, the 


lag compensator increases K p: Ky, Kan etc. by a factor (a/f), thereby reducing 
steady-state errors. 


rE = 1 
Vis) s+B RoC nR (R, +R,)C 


where a= 


Fig. 6.47 A lag compensator. 


A lag compensator improves the steady-state performance, but in general de- 
grades the transient performance. Since a > B, the magnitude of ø, the root locus 
centroid, is reduced. This reduction causes the root locus to shift toward the jw- 
axis, with the consequent deterioration of the transient performance. This side 
effect of a lag compensator can be made negligible by choosing a and £ such that 
a — is very small, but the ratio a /@ is high. Such a pair of pole and zero act like a 
dipole and has only a negligible effect on the transient behavior of the system. The 
root locus also changes very little. We can realize such a dipole by placing both 
the pole and the zero of G(s) close to the origin (a and 8 — 0). For instance, if 
we select a = 0.1 and £ = 0.01, the centroid will be shifted by only a negligible 
amount (a — B)/(n ~ m) = 0.09/(n ~ m). However, since a/8 = 10, all the error 
constants are increased by a factor 10. Thus, we can have our cake and eat it too! 
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We can improve the transient and the steady-state performance simultaneously by 
using a combination of lead and lag networks. 


6.7-6 Stability Considerations 


In practice, we rarely use positive feedback because, as explained earlier, such 
systems are prone to instability and are very sensitive to changes in the system 
parameters or environment. Would negative feedback make a system stable and less 
sensitive to unwanted changes? Not necessarily! The reason is that if a feedback 
were truly negative, the system would be stable. But a system that has negative 
feedback at one frequency may have a positive feedback at some other frequency 
because of phase shift in the transmission path. In other words, a feedback system, 
generally, cannot be described in black and white terms such as having positive or 
negative feedback. Let us clarify this statement by an example. 

Consider the case G(s)H(s) = 1/s(s + 2)(s +4). The root locus of this system 
appears in Fig. 6.43. This system shows negative feedback at lower frequencies. 
But because of phase shift at higher frequencies, the feedback becomes positive. 
Consider the loop gain G(s)H(s) at a frequency w = 2.83 (at s = 72.83). 


1 


GO Ge) = Gas Gea) 


At w = 2.83 


1 


1 —jisoe _ 1 


= —e 


48 48 


G (j2.83)H (j2.83) = 


Recall that the overall gain (transfer function) T (s) is 


KG(s) 


Ts) = Ty KG) He) 


At frequency s = j2.83 (w = 2.83), the gain is 


KG(j2.83 
T (j2.83) = eee 
48 


As long as K remains below 48, the system is stable, but for K = 48, the system gain 
goes to oo, and the system becomes unstable. The feedback, which was negative 
below w = 2.83 (because the phase shift has not reached —180°), becomes positive. 
If there is enough gain (K = 48) at this frequency, the signal fed back is equal to the 
input signal, and the signal perpetuates itself for ever. In other words, the signal 
starts generating (oscillating) at this frequency, which is precisely the instability. 
Note that the system remains unstable for all values of K > 48. This is clear from 
the root locus in Fig. 6.43, which shows that the two branches cross over to the 
RHP for K > 48. The crossing point is s = j2.83. 

This discussion shows that the same system, which has negative feedback at 
lower frequency may have positive feedback at higher frequency. For this reason, 
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eres system are quite prone to instability, and the designer has to pay a great 
eal of attention to this aspect. Root locus does indicate the region of stability. 


6.8 The Bilateral Laplace Transform 


Situations involving noncausal signals and/or systems cannot be handled by 
the (unilateral) Laplace transform discussed so far. These cases can be analyzed by 
the bilateral (or two-sided) Laplace transform defined by 


fo =] 
F(s)= J f(t)e~* at (6.101a) 
= 
and f(t) can be obtained from F(s) by the inverse transformation 
F ) 1 c+joo i 
t= a F şi 
re ae (s)e* ds (6.101b) 


Observe that the unilateral Laplace transform discussed so far is a special case of 
the bilateral Laplace transform, where the signals are restricted to the causal type 
Basically, the two transforms are the same. For this reason we use the same not. a , 
for the bilateral Laplace transform. i 
Earlier we showed that the Laplace transforms of e~ u(t) and of —e%u(—t) 
are identical. The only difference involves their regions of convergence. The region 
of convergence for the former is Res > —a; that for the latter is Res < ag as 
illustrated in Fig. 6.2. Clearly, the inverse Laplace transform of F(s) is not inde 
unless the region of convergence is specified. If we restrict all our signals to the causal 
type, however, this ambiguity does not arise. The inverse transform of 1/(s + a) 
is e~*u(t). Thus, in the unilateral Laplace transform, we can ignore the region of 
convergence in determining the inverse transform of F(s). 
as a nie a ae any bilateral transform can be expressed in terms of two 
ateral transforms. It is, ther: i i 
ee rei a possible to evaluate bilateral transforms from 
Consider the function f(t) appearing in Fig. 6.48a. We separate f (t) into two 
components, f;(t) and f(t), representing the positive time (causal) component 


and the negative time (anticausal) component of i i 
meen. ) ponent of f(t) respectively (Figs. 6.48b 


filt) = f(t)u(t) (6.102a) 


falt) = f (t)u(—t) (6.102b) 
The bilateral Laplace transform of f (t) is given by 


F(s) = f. f(t)e7** dt 


0 o0 
= f folt)e7 dt + I Jiltje dt 
= 0 


= F,(s) + Fi (s) (6.103) 
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fo) 
(a) 
0 t— 
fi) 
(b) 
0 io 
f(t) 
(Q) 
0 ee 


(d) 


Fig. 6.48 Expressing a signal as a sum of causal and anticausal components. 


where Fı(s) is the Laplace transform of the causal component fit) and F2(s) is 
the Laplace transform of the anticausal component f2(t). But F2(s) is given by 


0 
Fa(s) = L Peat 


= T Jal—t)e* dt 
0 


Therefore 
OO 
Ps) = | fal—t)e =” dt (6:104) 
0 


It is clear that F2(—s) is the Laplace transform of fo(—-t), which is causal (Fig. 
6.48d), so F,(—s) can be found from the unilateral transform table. Changing the 


sign of s in F2(—s) yields Fo(s). 
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To summarize, the bilateral transform F(s) in Eq. (6.103) can be computed 
from the unilateral transforms in two steps: 


1) Split f(t) into its causal and anticausal components, fy (t) and f(t), respec- 
tively. 

2) The signals fi (t) and f2(—t) are both causal. Take the (unilateral) Laplace 
transform of f,(t) and add to it the (unilateral) Laplace transform of fa(-t), with 
s replaced by —s. This procedure gives the (bilateral) Laplace transform of f(t) 


Since fi(t) and f2(—t) are both causal, F)(s) and Fo(—s) are both unilateral 
Laplace transforms. Let acı and o-2 be the abscissas of convergence of F(s) and 
F2(—s), respectively. This statement implies that F} (s) exists for all s with Res > 
acı, F2(—s) exists for all s with Res > ac2, and F2(s) exists for all s with Res < 
~c2. Because F(s) = F(s) + F2(s), F(s) exists for all s such that 


a < Res < —og (6.105) 


C] Region of convergence for causal component of f(t). 
= Region of convergence for anticausal component of f(z). 
|| Region (strip) of convergence for the entire f(t). 

Fig. 6.49. 


The regions of convergence (or existence) of F,(s), Fz (s), and F(s) are shown 
in Fig. 6.49. Because F(s) is finite for all values of s lying in the strip of convergence 
(ga < Res < —02), poles of F(s) must lie outside this strip. The poles of F(s) 
arising from the causal component fı(t) lie to the left of the strip (region) of 
convergence, and those arising from its anticausal component f(t) lie to its right 
(see Fig. 6.49). This fact is of crucial importance in finding the inverse bilateral 
transform. 


As an example, consider 
f(t) = eu(—t) + e%*u(t) (6.106) 
We already know the Laplace transform of the causal component 


1 
s—a 


e%u(t) <= Res >a (6.107) 


For the anticausal component, f2(t) = e*tu( —t), we have 
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bt 1 
fo{-t) =e" u(t) => — Res > ~b 
s+b t 1 
© w 
so that z 3 > “g 
Q 
1 —1 £% 
F(s) = = Res <b RE 
-s+b s- 2 3 28 
Therefore m 
—1 
eb u(—t) <> -oy Res<b (6.108) 
ra 


(g) 


and the Laplace transform of f(t) in Eq. (6.106) is 


1 1 
F(s) = —- + Res>a and Res<b 


a-b 
A CEE a< Res <b (6.109) 


Figure 6.50 shows f(t) and the region of convergence of F (s) for various values 
of a and b. Equation (6.109) indicates that the region of convergence of F(s) does 
not exist if a > b, which is precisely the case in Fig. 6.50g. Observe that the 
poles of F(s) are outside (on the edges) of the region of convergence. The poles of 
F(s) because of the anticausal component of f(t) lie to the right of the region of 
convergence, and those due to the causal component of f (t) lie to its left. 
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E Example 6.22 
Find the inverse Laplace transform of 


-3 22 
F(s) = -————~ 5s 
)= GFDET R 1 t 
if the region of convergence is (a) —2 < Res <1 (b) Res>1 (c) Res < -2. 
8 
a 1 «+3 3 3 
(a) F(s) = z337 > os S -3 = 


Now, F(s) has poles at —2 and 1. The strip of convergence is —2 < Res < 1. The pole at 
—2, being to the left of the strip of convergence, corresponds to the causal signal. The pole 
at 1, being to the right of the strip of convergence, corresponds to the anticausal signal. 


Equations (6.107) and (6.108) yield 


(a) 
(b) 


t- 
— 


f(t) =e" **u(t) + e’u(—t) 


eat 


f(t) 


(b) Both poles lie to the left of the region of convergence, so both poles correspond 
to causal signals. Therefore 


f(t) 


f(t) = (e™™ — eult) 


(c) Both poles lie to the right of the region of convergence, so both poles correspond 
to anticausal signals, and 


f(t) = (-e7™* + e*u(—t) 
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f(t) f(t) 
-4 


ota 


(b) (c) 


Fig. 6.51 Three possible inverse transforms of Ger: 


Figure 6.51 shows the three inverse transforms corresponding to the same F(s) but 
with different regions of convergence. E 


6.8-1 Linear System Analysis Using the Bilateral Transform 


Since the bilateral Laplace transform can handle noncausal signals, we can 
analyze noncausal LTIC systems using the bilateral Laplace transform. We have 
shown that the (zero-state) output y(t) is given by 


y(t) = £7" [F (s)H (s)] (6.110) 


This expression is valid only if F(s)H (s) exists. The region of convergence of 
F(s)H(s) is the region where both F(s) and H (s) exist. In other words, the region 
of convergence of F(s)H(s) is the region common to the regions of convergence of 
both F(s) and H(s). These ideas are clarified in the following examples. 


E Example 6.23 
Find the current y(t) for the RC circuit in Fig. 6.52a if the voltage f(t) is 


f(t) = eult) + e*u(—t) 
The transfer function H(s) of the circuit is given by 
H(s) = $ 


s+i 
Because h(t) is a causal function, the region of convergence of H (s) is Res > —1. Next, 


the bilateral Laplace transform of f(t) is given by 
1 1 -1 

= —- = 1<Res<2 

F(s) s-1 s-2 (s-l1)(s-2) eee 
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F(t) 
(a) 


H © 


Fig. 6.52 Response of a circuit to a noncausal input (Example 6.23). 


The response y(t) is the inverse transform of F(s)H(8) 


Zp 
ylt)=£ he] 


= [5 1 i 2 1 
6s+1 ria rer 


Th A ; 

Ro m pies of F(s)H(s) is that region of convergence common to both 
AAN ae eas : < Res < i The poles s = +1 lie to the left of the region of 
; j , correspond to causal signals; the pole s = 2 li i 
the region of convergence and thus represents an anticausal signal. Hence reer 


y(t) = eult) + Ze*u(t) + 2e*u(-t) 
Figure 6.52c shows y(t). Note that in this example, if 


f(t) = e7 u(t) + e *u(—t) 


hen the regi n of conver is — = B. 

(o) gence of F(s) is -4< Res < —2 Here no regi ie) 
t Vi , e region of convergence 
exists for F (s)H(s), and the response y(t) goes to infinity. E 


a Example 6.24 
Find the response y(t) of a noncausal system with the transfer function 
= 
H(s) = —— 
(s) aa] Res <1 


to the input f(t) = e~?*u(t). 
We have 


and 
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-1 
(s — 1)(s + 2) 


The region of convergence of F(s)H(s) is, therefore, the region —2 < Res < 1. By partial 
Taction expansion 


Y(s) = F(s)H(s) = 


—1/3 1/3 
s-1 s8s+2 


Y (s) = —2<Res<l 


and 
y(t) = 3 [e'u(—t) + e~*u(t)] 


Note that the pole of H(s) lies in the RHP at 1. Yet the system is not rae 
pole(s) in the RHP may indicate instability or noncausality, depending sid i os a 
with respect to the region of convergence of H (s). For example, E H(s) z en 
with Res > 1, the system is causal and unstable, with h(t) = —e*u(t). In con ; 


“ B AF ae 
H(s) = —1/(s—1) with Res < 1, the system is noncausal and stable, with h(t) = e*u(—t). 
@ Example 6.25 
Find the response y(t) of a system with the transfer function 


H(s) = Res > —5 


s+5 
and the input 
f(t) =e7*u(t) + e7*u(-t) 


The input f(t) is of the type depicted in Fig. 6.50g, and the region of oe 
for F(s) does not exist. In this case, we must determine separately the system response 
to each of the two input components, fi(t) = e™*u(t) and f2(t) = e u(—t). 


Fi(s) = z7 Res > -1 
-1 
Fa(s) = 375 Res < —2 


If yi(t) and yo(t) are the system responses to fi(t) and fo(t), respectively, then 


1 
(s + 1)(s + 5) 
1/4 1/4 
stl s+65 


Yi(s) = Res>-l 


so that 
y(t) = 1 (e= - e**) u(t) 

and 

_ -1 

~ (3+ 2)(s +5) 


_ 71/3 1/3 
~ g6+2 s+5 


= -2 
¥2(s) 5<Res< 
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so that 


yo(t) = 4 [e~**u(—t) + e*u(t)] 


Therefore 


y(t) = y(t) + y2(t) 


6.9 Appendix 6.1: Second Canonical Realization 


An nth-order transfer function can also be realized by a second canonical (ob- 
server canonical) form. As in the case of the first canonical, we begin with a 
realization of a third-order transfer function in Eq. (6.71) 


H(s) = ¥(s) = b383 + bas? + bys + bo 


C F(s) > ao bape? + ais Fao (6.111) 
Therefore 
(s? + as? + ais + ao)Y (s) = (b38? + bos? + bis + bo) F (8) 
Transporting all but the first term on the right-hand side yields 
s°Y (s) = b38? F (8) + [aY (s) + baF (8)]s? + [-a1Y (s) + b1F(s)]s 
+ [-ao¥ (s) + boF (s)] 
Dividing throughout by s3 yields 
Y (s) = b3F (s) + ~[-a2¥ (s) +b2F(s)] + Zl-aY (s) + 61 F(s)] 
+ 5l-a0¥ (s) + boF (s)] (6.112) 


Therefore, Y (s) can be generated by adding four signals appearing on the right-hand 
side of Eq. (6.112). We shall build Y (s) step by step, adding one component at a 
time. Figure 6.53a shows only the first component; that is, b3F (s). Figure 6.53b 
shows Y (s) formed by the first two components, b3F (s) and +[~a2Y(s) + b2F (8)]. 
Observe that the term a2Y (s) is obtained from Y (s) itself. We add —a2¥(s) to 
b2F (s) and pass it through an integrator to obtain 2[-a2¥ (s) + boF(s)]. Figure 
6.53c shows Y (s) built up from the first three components. Finally, Fig. 6.53d shows 
Y (s) built up from all the components. This is the final form, which represents an 
alternative realization of H(s) in Eq. (6.111). 


This realization can be readily generalized for an nth-order transfer function 
in Eq. (6.70) using n integrators. 


Fig. 6.53 Second (observer) canonical realization of an nth-order transfer function. 


6.10 Summary 


The Fourier transform cannot be used directly in analysis of meee a sea 
marginally stable systems. Moreover, the inputs must also be Sani oe i 
transformable signals, which leaves out exponentially growing signa s. : sae 
limitations are the result of the fact that the spectral components used in : a AE 
transform to synthesize a signal f(t) are ordinary sinusoids or exponen $ S ioe 
form e*t, whose frequencies are restricted to the jw axis in the complex plane. 
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These spectral components are incapable of synthesizing exponentially growing sig- 
nals. We extend the Fourier transform by generalizing the frequency variable from 
s = jw tos =o + jw. The resulting transform is the Laplace transform, which 
can analyze all types of LTIC systems. The Laplace transform can also handle 
exponentially growing signals. 

The system response to an everlasting exponential e** is also an everlasting 
exponential H(s)e*, where H (s) is the system transfer function. We can view the 
Laplace transform as a tool by which a signal is expressed as a sum of everlasting 
exponentials e%. The relative amount of a component e't is F(s). Therefore F(s), 
the Laplace transform of f(t), represents the spectrum of exponential components 
of f(t). Moreover, H (s) is the system response (or gain) to a spectral component 
e*, and the output signal spectrum is the input spectrum F(s) times the spectral 
response (gain) H (s) [Y (s) = F(s)H(s)}. 

The Laplace transform changes integro-differential equations of LTIC systems 
into algebraic equations. Therefore, solving these integro-differential equations re- 
duces to solving algebraic equations. The Laplace transform method cannot gener- 
ally be used for time-varying parameter systems or for nonlinear systems. 

The transfer function of a system may also be defined as a ratio of the Laplace 
transform of the output to the Laplace transform of the input when all initial 
conditions are zero (system in zero state). If F(s) is the Laplace transform of the 
input f(t) and Y (s) is the Laplace transform of the corresponding output y(t) (when 
all initial conditions are zero), then Y(s) = F(s)H(s), where H(s) is the system 
transfer function. The system transfer function H (s) is the Laplace transform of the 
system impulse response A(t). Like the impulse response h(t), the transfer function 
H (s) is also an external description of the system. 


Electrical circuit analysis can also be carried out by using a transformed circuit 
method, in which all signals (voltages and currents) are represented by their Laplace 
transforms, all elements by their impedances (or admittances), and initial conditions 
by their equivalent sources (initial condition generators). In this method, a network 
can be analyzed as if it were a resistive circuit. 

Large systems can be considered as suitably interconnected subsystems repre- 
sented by blocks. Each subsystem, being a smaller system, can be readily analyzed 
and represented by its input-output relationship, such as its transfer function. Anal- 
ysis of large systems can be carried out with the knowledge of input-output rela- 
tionships of its subsystems and the nature of interconnection of various subsystems. 

LTIC systems can be realized by scalar multipliers, summers, and integrators. 
A given transfer function can be synthesized in many different ways. Canonical, 
cascade, and parallel forms of realization are discussed. In practice, all the building 
blocks (scalar multipliers, summers, and integrators) can be obtained from opera- 
tional amplifiers. 

Feedback systems are closed-loop systems mainly used to counteract the effects 
of unpredictable variations in the system parameters, the load, and the environment. 
Such systems are designed for a specified speed and the steady-state error. For 
speed, the useful transient parameters are rise time, peak time, and settling time. 
Percent overshoot indicates how smoothly the system output rises to its final value. 
We can relate the steady-state error to system parameters. In many cases, adjusting 
the amplifier gain K can result in the desired performance. If the requirements 
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cannot be satisfied by mere adjustment of gain, then some form of compensation 
must be used. The loci of the characteristic roots of the system are called the root 
locus, which proves extremely convenient in designing a feedback system. 

Most of the input signals and practical systems are causal. Consequently, we 
are required most of the time to deal with causal signals. When all signals are 
restricted to the causal type, the Laplace transform analysis is greatly simplified; 
the region of convergence of a signal becomes irrelevant to the analysis process. 
This special case of the Laplace transform (which is restricted to causal signals) 
is called the unilateral Laplace transform. Much of the chapter deals with this 
variety of Laplace transform. Section 6.8 discusses the general Laplace transform 
(the bilateral Laplace transform), which can handle causal and noncausal signals 
and systems. In the bilateral transform, the inverse transform of F(s) is not unique 
but depends on the region of convergence of F(s). Thus the region of convergence 
plays a very crucial role in the bilateral Laplace transform. 


References 


1. Doetsch, G., Introduction to the Theory and Applications of the Laplace Trans- 
formation with a Table of Laplace Transformations, Springer Verlag, New York, 
1974. 

2. LePage, W.R., Complex Variables and the Laplace Transforms for Engineers, 
McGraw-Hill, New York, 1961. 


3. Durant, Will, and Ariel, The Age of Napoleon, The Story of Civilization Series, 
Part XI, Simon and Schuster, New York, 1975. 


Bell, E.T., Men of Mathematics, Simon and Schuster, New York, 1937. 


5. Nahin, P.J., “Oliver Heaviside: Genius and Curmudgeon,” IEEE Spectrum, 
vol. 20, pp. 63-69, July 1983. 

6. Berkey, D., Calculus, 2nd ed., Saunder’s College Publishing, Philadelphia, Pa. 
1988. 

7. Encyclopaedia Britannica, Micropaedia IV, 15th ed., Chicago, IL. 1982. 

8. Churchill, R.V., Operational Mathematics, 2nd ed, McGraw-Hill, New York, 
1958. 


9. Yang, J.S. and Levine, W.S. Chapter 10 in The Control Handbook, CRC Press, 
1996. 
Problems 


i,1-1 By direct integration [Eq. (6.8b)] find the Laplace transforms and the region of con- 
vergence of the following functions: 


(a) u(t) — u(t - 1) (e) cos wit cos wet u(t) 
(b) te™ *u(t) (f) cosh (at) u(t) 
(c) tcos wot u(t) (g) sinh (at) u(t) 
(d) (e7* — 2e7*)u(t) (h) e7” cos (5t + 6) u(t) 


Problems 


sin £ 


(b) 


Fig. P6.1-2 


6.1- i i i 
1-2 By direct integration find the Laplace transforms of the signals shown in Fig. P6.1-2 


6.1-3 Find the inverse (unilateral) Laplace transforms of the following functions: 


2s +5 

Sas rere, Ot 
(b) 3s+5 1 

s? +4s +13 ones 
ett s+1 

acy CFI tT 
rem OEA 
3 ee (s + 1)?(s2 +2845) 


(s + 1)(s? +25 +2) 


6.2-1 Find the Laplace transforms of t 


r he following fi i i 
AT eaea peeve g functions using only Table 6.1 and the 


) of the unilateral Laplace transform: 
(a) u(t) — u(t ~ 1) 
(b) eae -=7) 


(e) te~*u(t — T) 

(£) sin [wo(t ~ r)] u(t — 7) 
(c) eu (t) (g) sin [wo(t ~ r)] u(t) 
(d) e~*u(t ~ 7) (h) sin wot u(t — 7) 


6.2-2 Using only Table 6.1 and the ti 
of the signals in Fig. P6.1-2. 


Hint: See Sec. 1.4 for discussion of expressing such signals analytically. 


me-shifting Property, determine the Laplace transform 


6.2-3 Find the inverse Laplace transforms of the following functions: 
(a) (2s + 5)e~?* e PD 43 
s?+5s+6 ae 
3s 
b) 56 +2 ee +e7% 47 
OE ree (a) 5? +3s +2 


6.2-4 The Laplace transform of a cau: 


sal periodic signal can b i 
seed igs eae g n be determined from the knowl- 


of its first cycle (period). 
(a) If the Laplace transform of f(t) in Fig. P6.2-4a is F 


Laplace transform of g(t) [Fig. P6.2-4b], is eae Se Sues 


F(s 
G(s) = aw Res>0 
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f(t) 


(a) (b) 


(c) 


2 8 10 16 18 24 pe 
Fig. P6.2-4 


(b) Using this result, find the Laplace transform of the signal p(t) illustrated in Fig. 
P6.2-4c. 
Hint: l+a2+ a2? +r? += nS for |z| < 1. 


.2-5 Starting only with the fact that 6(t) > 1, build Pairs 2 through 10b in Table 6.1, 
using various properties of the Laplace transform. Hint: u(t) is the integral of &(t), 
tu(t) is integral of u(t) [or second integral of 6(t)], and so on. 


-2-6 (a) Find the Laplace transform of the pulses in Fig. 6.3 in the text by using only the 
time-differentiation property, time-shifting property, and the fact that 5(t) <=> 1. 
(b) In Example 6.7, the Laplace transform of f(t) is found by finding the Laplace 
transform of d? f /dt?. Find the Laplace transform of f (t) in that example by finding 


the Laplace transform of df /dt. 
Hint for part (b): df/dt can be expressed as a sum of step functions (delayed by 
various amounts) whose transforms can be determined readily. 


3-1 Using the Laplace transform, solve the following differential equations: 
(a) (D? + 3D +2) y(t) = Df(t) if y(07) = ġ(07) = 0 and f(t) = u(t) 
(b) (D? +4D +4) y(t) = (D + 1)f(t) if y(07) = 2, (07) = 1 and f(t) = e~*u(t) 


(c) (D? + 6D + 25) y(t) = (D + 2) f(t) if y(07) = ġ(07) = 1 and f(t) = 25u(t) 


-3-2 Solve the differential equations in Prob. 6.3-1 using the Laplace transform. In each 
case determine the zero-input and zero-state components of the solution. 


-3-3 Solve the following simultaneous differential equations using the Laplace transform, 
assuming all initial conditions to be zero and the input f(t) = u(t): 
(a)(D + 3)ya(t) — 2y2(t) = f(t) 
~ 2yi(t) + (2D + 4)yo(t) = 0 
(b)(D + 2)yi(t) - (D + 1)y2(t) = 0 
= (D+ 1)ya(t) + (2D + 1)y2(t) = f(t) 


Determine the transfer functions relating outputs yi(t) and yo(t) to the input f(t). 
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Fig. P6.3-4 


6.3-4 For the circuit in Fig. P i is i 
ig. P6.3-4, the switch is i iti i 
t = 0, when it is closed instantaneously. Coe ea sane Paes 
(a) Write loop equations (in time domain) for t > 0 
(b) Solve for yi(t) and yo(t b i Cap 
Seas a ) y2(t) by taking the the Laplace transform of loop equations 
6.3-5 For each of the systems described by 
system transfer function: 
dy dy df 
(a) Ji? + ua + 24y(t) = 57 + 3f(t) 
By æ d F 
b) £Y ay _ dy d d 
O) Gas + Og G + 6000) =s E 47% sro 
d'y dy _ „df 
(c) Prey ey wg + 2f(t) 


6.3-6 For each of the systems speci i 
i 1 pecified by the following transfer f i i 
ential equation relating the output y(t) to the input f (t): D EA RERE 


the following differential equations, find the 


(a) H(s)= -<15 ib) Hian $ +388 +5 
sai toits 
ee ew s$ +88? + 5s 47 
(c) H(s) = 28 +7s+2 
s?— 2545 


6.3-7 For a system with transfer function 
s+5 
s? + 5546 
(a) Find the (zero-state) response if the input f(t) is: 
i) e~3tult) (ii) 74t i) 0 —4(t—5 ; 
(i) (t) (ii) e~**u(t) (iii) e74 Ju(t—5) (iv) e ACS) u(t) (v) e~u(t—5), 


(b) For this system write the di i i i 
RF e differential equation relating the output y(t) to the 


6.3-8 Repeat Prob. 6.3-7 if 


H(s) = 


_ 2s+3 
l (s) s? +2545 
and the input f(t) is: (a) 10u(t) (b) u(t- 5). 
6.3-9 Repeat Prob. 6.3-7 if 


H(s) = —5— 
(s) EN 


and the input f(t) = (1 — e™*)u(t) 
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3-10 For an LTIC system with zero initial conditions (system initially in zero state), if an 
input f(t) produces an output y(t), then show that: 
(a) the input df/dt produces an output dy/dt, and 
(b) the input fe f(r) dr produces an output R y(t) dr. Hence, show that the unit 
step response of a system is an integral of the impulse response; that is, i h(r) dr. 


Fig. P6.4-1 


y(t) 


10V = 2H 


Fig. P6.4-2 


y(t) 


fog 


Fig. P6.4-3 


6.4-1 Find the zero-state response vo(t) of the network in Fig. P6.4-1 if the input voltage 
f(t) = te-tu(t). Find the transfer function relating the output vo(t) to the input 
f(t). From the transfer function, write the differential equation relating vo(t) to f(t). 


6.4-2 The switch in the circuit of Fig. P6.4-2 is closed for a long time and then opened 
instantaneously at t = 0. Find and sketch the current y(t). 


6.4-3 Find the current y(t) for the parallel resonant circuit in Fig. P6.4-3 if the input is 
(a) f(t) = Acos wot u(t) , 1 

w = — 

(b) f(t) = Asin wot u(t) LC 


Assume all initial conditions to be zero. 
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6.4-4 


6.4-5 


6.4-6 


6.4-7 


6.4-8 


f(t) 
6 
3 
0 t— 
(b) 
Fig. P6.4-4 
y,(@) 2H y(t) 1H 


10V 


f(t) 


Fig. P6.4-6 


ind el p curr yı( ) Ni + oe 
ya(t for t > C: 
F p Jin ents t) and ( ) t 0 in the circuit of Fig. P6.4-4a for the 


aa the network in Fig. P6.4-5 the switch is in a closed position for a long time before 
= 0, when it is opened instantaneously. Find y1(t) and us(t) for t > 0. 


Find the output voltage vo(t) for t > 0 fi ircuit i 
> 0 for the circuit in Fig. P6.4-6, if the i 
f(t) = 100u(t). The system is in zero state initially. 5 MER E 


a a = naes vo(t) for the network in Fig. P6.4-7 if the initial conditions 
1(0) = and vc(0) = - (Hint: initi iti 

pains a c(0) = 3 V. (Hint: Use the parallel form of initial condition 
For the network in Fig. P6.4-8, the switch is in position a for a long time and then is 
moved to position b instantaneously at t = 0. Determine the current (t) for t > 0 
Hint: Use the Thévenin equivalent. z an 
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1/8 Q 


Qu (t) 


Fig. P6.4-7 


t=0 1/5 y(t) 20 2a 
a 
b 
1H 
ov == 
woy = 


Fig. P6.4-8 


Fig. P6.4-9 


i t 
6.4-9 Show that the transfer function which relates the output voltage y(t) to the inpu 
l voltage f(t) for the op amp circuit in Fig. P6.4-9a is given by 


K sype = 
H(s)= = where Kaltp and a RG 


and that the transfer function for the circuit in Fig. P6.4-9b is given by 


H(s) = PEA 
6.4-10 For a second-order op amp circuit in Fig. P6.4-10, show that the ae function 
l H(s) relating the output voltage vo(t) to the input voltage f(t) given by 
-=s 


H(s) = 278112 


initi he zero- 
6.4-11 Using the initial and final value theorems, find the initial and final value of the z 
l state response of a system with the transfer function 


68s? +3s + 10 


H(s) = 946845 


Problems ; ie 


Fig. P6.4-10 


and the input (a) u(t) (b) e-*u(t). 
6.5-1 Figure P6.5-1a shows two resistive ladder segments. The transfer function of each 


segment (ratio of output to input voltage) is 3. Figure P6.5-1b shows these two 
segments connected in cascade. 

(a) Is the transfer function (ratio of output to input voltage) of this cascaded network 
DG = 9? 

(b) If your answer is affirmative, verify the answer by direct computation of the 
transfer function. Does this computation confirm the earlier value +? If not, why? 
(c) Repeat the problem with R3 = R4 = 200. Does this result suggest the answer to 
the problem in part (b)? 


R,=2Q R =1Q zi b 


OQ) iG 


R,=2Q R,=12 


S (b) 
Fig. P6.5-1 


6.5-2 In Fig. 6.18, hi(t) and h2(t) are the impulse responses of systems with transfer func- 
tions Hi(s) and H2(s), respectively. Determine the impulse response of the cascade, 
and parallel combination of Hi(s) and H2 (s) shown in Fig. 6.18b and c. 

6.6-1 Realize 

3(s + 2) 

(s +.1)(s + 3)(s + 4) 
by canonical, series, and parallel forms. 

6.6-2 Repeat Problem 6.6-1 if 


H(s) = 


x 3s(s + 2) 
A Geet aa) 
(b) H(s) = 28-4 


(s + 2)(s? + 4) 
6.6-3 Repeat Problem 6.6-1 if 


2s +3 
H() = See FI) 
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Y(s) 


Fig. P6.6-7 


Hint: Normalize the highest-power coefficient in the denominator to unity. 
6.6-4 Repeat Problem 6.6-1 if 
s(s +1)(s + 2) 
H(s) = se 
{s + 5)(s + 6)(s + 8) 
Hint: Here m =n = 3. 


6.6-5 Repeat Problem 6.6-1 if 
3 


3 
H(s) = TGFA) 
6.6-6 Repeat Problem 6.6-1 if 
3 
8 
BAS) = (s + 1)(s? + 4s + 13) 


j i in: 
6-7 In this problem we show how a pair of complex conjugate poles may x space E 
oe a cascade of two first-order transfer functions. Show that the transfer fu 


the block diagrams in Figs. P6.6-7a and b are 


1 Soa o a 
(a) H(s) = (eta)? +b?  85?+2as + (a? +b?) 
sta st+a 


(b) HO = Fa Fo ~ a4 Dust (+H) as | 
Hence, show that the transfer function of the block diagram in Fig. P6.6-7c is 
As+B As+B 
(0) HO) = Fap ri = 4 das + (+h) 
6.6-8 Show op amp realization of the following transfer functions: 
-10 wy 10 
Os Œ yrs 


na S42 
(iii) 345 
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6.6-9 Show two different op amp circuit realizations of the transfer function 


s+2 3 
HOS se Gas 
6.6-10 Show op amp canonical realization of the transfer function 
_ 8847 
s?+4s+10 
6.6-11 Show op amp canonical realization of the transfer function 


H(s)= 


Ge s°+5s+2 
s?+45+13 
6.7-1 Determine the rise time t,, the settling time ts, the PO, and the steady-state errors 
€s, €r, and ep for each of the following systems, whose transfer functions are: 


Omrum Carat © amer 


83? +3s+9 8? +383 +4 


Fig. P6.7-2 


6.7-2 For a position control system depicted in Fig. P6.7-2, the unit step response shows 
the peak time tp = 7/4, the PO = 9%, and the steady-state value of the output for 
the unit step input is yss = 2. Determine Kı, Kz and a. 


Fig. P6.7-3 


6.7-3 For a position control system illustrated in Fig. P6.7-3 the following specifications 


are imposed: tr < 0.3, ts < 1, PO < 30% and es = 0. Which of these specifications 
cannot be met by the system for any value of K? Which specifications can be met 
by simple adjustment of K? 


6.7-4 Open loop transfer functions of four closed-loop systems are given below. In each 


case, give a rough sketch of the root locus. 


K(s +1) K(s +5) 
a Ser aye +5) (9 F3) 
i) K(s+1) K(s+1) 


s(s + 3)(s + 5)(s +7) (a) s(s + 4)(s? + 2s + 2) 
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Y(s) 


Fig. P6.7-5 


6.7-5 For a unity feedback system shown in Fig. P6.7-5, We are Sct A 
i specifications PO < 16%, tr < 0.2, ts S 0.5, e, = 0 and er < 0.06. a a sacle 
to meet these specifications just by adjusting K? If not, suggest a sul 
compensator and find the resulting PO, ts, tr, es and er. : ee 
6.8-1 Find the region of convergence, if it exists, of the (bilateral) Laplace transform o 
following signals: 


1 kt? 
tu(t) —tu(t) 1 (a) (ee kt 
(a) (be © r Ome 


6.8-2 Find the (bilateral) Laplace transform and the corresponding region of convergence 
for the following signals: 


(a) e7"! (b) e7"! cos t (c) etu(t) + or l 
(a) et (e) et") (£) cos wot u(t) + e* u(—t) 


6.8-3 Find the inverse (bilateral) Laplace transforms of the following functions: 
2s +5 
(@) FAG+) 
2s- 5 
O Te-a) 
2s +3 
© GanGrd 
28s +3 
d Gane+D 
3s? — 28 — 17 
(©) GEnerae-5) 


6.8-4 Find 
4 28? — 2s — 6 | 
£ (s + 1)(s — 1)(s + 2) 


-3<0< -2 
2<0<3 
o>-—l 


a<-2 


if the region of convergence is (a) Re s> 1 (b) Re s< -2 
—2 < Re s< -1 
(c) —1< Re s<1 (d) , 
6.8-5 Fora causal LTIC system having a transfer function H(s) = i find the output y(t) 
if the input f(t) is given by 
(a) e7"? (d) e?*u(t) + eult) 


(b) eu(t) + e”u(—t) (e) e7*/4u(t) + et! ult) 


(c) et u(t) + e™ tult) (£) eult) + e°” u(—t) 


Frequency Response and 
Analog Filters 


Filtering is an important area of signal processing. We have already discusse 
ideal filters in Chapter 4. In this chapter, we shall discuss the practical filter char 
acteristics and their design. Filtering characteristics of a filter are indicated by it 
response to sinusoids of various frequencies varying from 0 to oo. Such character 
istics are called the frequency response of the filter. Let us start with determinin, 
the frequency response of an LTIC system. 

Recall that for h(t), we use the notation H (w) for its Fourier transform an 
H(s) for its Laplace transform. Also, when the system is causal and asymptoticall: 
stable, all the poles of H(s) lie in the LHP. Hence, the region of convergence for H (s 
includes the jw axis, and we can obtain the Fourier transform H (w) by substitutin, 
s = jw in the corresponding Laplace transform H (s) (see P. 370). Therefore, H (jw 
and H(w) represent the same entity when the system is asymptotically stable. Ir 


this and later chapters, we shall often find it convenient to use the notation H(jw 
instead of H(w). 


7.1 Frequency Response of an LTIC System 


In this section we find the system response to sinusoidal inputs. In Sec. 2.4-3 we 
showed that an LTIC system response to an everlasting exponential input f (t) = e* 
is also an everlasting exponential H (s)e**. As before, we represent an input-output 
pair using an arrow directed from the input to the output as 


e* => H(s)e* (7.1) 

Setting s = +jw in this relationship yields 
ett => H(jw)eit 7.2a) 
eit => H(—jwje it (7.2b) 


Addition of these two relationships yields 


2cos wt => H (jw)e?™t + H(—jw)e™i“t = 2Re [H(jw)e**} (7.3) 
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We can express H(jw) in the polar form as 
H (jw) = |H (jw) e440") (7.4) 
With this result, the relationship (7.3) becomes 


cos wt => |H (jw) cos [wt + ZH (jw)] 


In other words, the system response y(t) to a sinusoidal input cos wt is given by 


y(t) = |H (jw)| cos [wt + 2H (jw)] (7.5a) 


Using a similar argument, we can show that the system response to a sinusoid 
cos (wt + 6) is 


y(t) = |H(jw)|cos [wt + 6 + ZH (jw) (7.5b) 


This result, where we have let s = jw, is valid only for asymptotically stable systems 
because the relationship (7.1) applies only for the values of s lying in the region of 
convergence for H(s). For the case of unstable and marginally stable systems, this 
region does not include the imaginary axis s = jw (see also the footnote on p. 243). 

Equation (7.5) shows that for a sinusoidal input of radian frequency w, the 
system response is also a sinusoid of the same frequency w. The amplitude of the 
output sinusoid is |H (jw)| times the input amplitude, and the phase of the output 
sinusoid is shifted by LH (jw) with respect to the input phase (see Fig. 7.1). For 
instance, if a certain system has |H(j10)| = 3 and ZH (j10) = —30°, then the system 
amplifies a sinusoid of frequency w = 10 by a factor of 3 and delays its phase by 30°. 
The system response to an input 5cos(10t + 50°) is 3 x 5cos (10t + 50° — 30°) = 
15 cos (10t + 20°). 

Clearly |H (jw)| is the system gain, and a plot of |H (jw)| versus w shows the 
system gain as a function of frequency w. This function is more commonly known as 
the amplitude response. Similarly, ZH (jw) is the phase response and a plot of 
LH (jw) versus w shows how the system modifies or changes the phase of the input 
sinusoid. These two plots together, as functions of w, are called the frequency 
response of the system. Observe that H (jw) has the information of |H (jw)| and 
ZH (jw). For this reason, H (jw) is also called the frequency response of the 
system. The frequency response plots show at a glance how a system responds to 
sinusoids of various frequencies. Thus, the frequency response of a system represents 
its filtering characteristic. 


E Example 7.1 
Find the frequency response (amplitude and phase response) of a system whose trans- 
fer function is 


s+0.1 
sia = s+5 
Also, find the system response y(t) if the input f(t) is (a) cos 2t (b) cos (10¢ — 50°). 
In this case 
; jw +0.1 
H = 
Go) = Fats 


Recall that the magnitude of a complex number is equal to the square root of the sum of 
the squares of its real and imaginary parts. Hence 


Vw? +0.01 


Hu) = Saree 


and ZH (jw) = tan"! (=) —tan7! (2) 
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[H gow] 


f(t) = cos 2 


Fig. 7.1 Frequency response of an LTIC system in Example 7.1. 


Both the amplitude and the phase res 
These plots furnish the complete infor 
to sinusoidal inputs. 


(a) For the input f(t) = cos 2t, w = 2, and 


|H(j2)| = AEE 0.372 
J(2)?+25 ` 


2H(j2) = tan“! (=)- -1 
) g1) te 


ponse are depicted in Fig. 7.la as functions of w 
mation about the frequency response of the system 


2 
(5) = 87.1° — 21.8° = 65.3° 


We also could have read these val 


5 di 
Fig. 7.la onead ee ues directly from the frequency response plots in 


2. This result me: i i i 
: j ; ans that for a sinusoidal i 
npa oi mi 2, P amplitude gain of the system is 0.372, and the Pase mee a 
pen h S, t e output amplitude is 0.372 times the input amplitude, and the h: ; 
put is shifted with respect to that of the input by 65.3°. Th f ek 
response to an input cos 2t is career 


y(t) = 0.372 cos (2t + 65.3°) 


The input cos 2¢ and the cor d 
es 
trated in Fig 71b. responding system response 0.372 cos (2t + 65.34°) are illus- 
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(b) For the input cos (10t—50°), instead of computing the values HH (jw)| and ZH (jw) 
as in part (a), we shall read them directly from the frequency response plots in Fig. 7.1a 
corresponding to w = 10. These are: 


|H(j10)| = 0.894 and ZH(j10) = 26° 


Therefore, for a sinusoidal input of frequency w = 10, the output sinusoid amplitude is 

0.894 times the input amplitude and the output sinusoid is shifted with respect to the 

input sinusoid by 26°. Therefore, y(t), the system response to an input cos (10t — 50°), is 
y(t) = 0.894 cos (10 — 50° + 26°) = 0.894 cos (10t — 24°) 


If the input were sin (10t — 50°), the response would be 0.894 sin (10t — 50° + 26°) = 


0.894 sin (10t — 24°). 
The frequency response plots in Fig. 7.1a show that the system has highpass filtering 


characteristics; it responds well to sinusoids of higher frequencies (w well above 5), and 
suppresses sinusoids of lower frequencies (w well below 5). E 


© Computer Example C7.1 
Plot the frequency response of the transfer functions H(s) = pith. 


num=[1 5); 
den=[1 3 2}; 
w=.1:.01:100; 


axis({log10(.1) log10(100) -50 50]) 
[mag,phase,w]=bode(num,den,w); 
subplot (211),semilogx(w,20*log10(mag)) 
subplot(212),semilogx(w,phase) © 


E Example 7.2 

Find and sketch the frequency response (amplitude and phase response) for 

(a) an ideal delay of T seconds; 

(b) an ideal differentiator; 

(c) an ideal integrator. 

(a) Ideal delay of T seconds: The transfer function of an ideal delay is [see Eq. 
(6.54)] 
H(s) =e *? 

Therefore 
H(jw) = eT 

Consequently 

|H(jw)| =1 and LH (jw) = -wT (7.6) 
This amplitude and phase response is shown in Fig. 7.2a. The amplitude response is 
constant (unity) for all frequencies. The phase shift increases linearly with frequency with 
a slope of -T. This result can be explained physically by recognizing that if a sinusoid 
cos wt is passed through an ideal delay of T seconds, the output is cos w(t — T). The 
output sinusoid amplitude is the same as that of the input for all values of w. Therefore, the 
amplitude response (gain) is unity for all frequencies. Moreover, the output cos w(t-T) = 
cos (wt —wT) has a phase shift -wT with respect to the input cos wt. Therefore, the phase 
response is linearly proportional to the frequency w with a slope —T. 


(b) An ideal differentiator: The transfer function of an ideal differentiator is [see 
Eq. (6.55)] 
H(s)=s 
Therefore 


(jw) = jw = we”? 
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Ideal Delay Ideal Differentiator Ideal Integrator 


“| [Ego] lH Go| ron 
0 Oo» 0 dc 0 ine 
<H (jw) ZH (jo) 
n/2 
Q 
0 da 0 
~n/2 
(a) (b) K 


Fig. 7.2 Frequency response of an ideal (a) delay (b) differentiator (c) integrator. 


Consequently 
|H(jw)|=w and LH(jw)= 4 (7.7) 


This amplitude and phase response is depicted in Fig. 7.2b. The amplitude response 
Eai linearly with frequency, and phase response is constant (7/2) for all frequencies. 
is result can be explained physically by recognizing that if a sinusoid cos wt is passed 
through an ideal differentiator, the output is -wsin wt = w cos (wt + 3): Therefore, the 
output sinusoid amplitude is w times the input amplitude; that is, the amplitude reponse 
(Enia) T reed with frequency w. Moreover, the output sinusoid undergoes a 
phase shift 5 with respect to the input cos wt. Therefore, the ph i 
(n/2) oa has ı the phase response is constant 
z In an ideal differentiator, the amplitude response (gain) is proportional to frequency 
[H (jw)| = w], so that the higher-frequency components are enhanced (see Fig. 7.2b). 


c) An id i : : : : 
( ay ) An ideal integrator: The transfer function of an ideal integrator is [see Eq. 


H(s) =+ 
s 
Therefore 
H (jw) = = = Z2 = 1 ini 
ju w w 
Consequently 


and LH (jw) = = (7.8) 


This amplitude and phase response is illustrated in Fig. 7.2c. The amplitude response is 
inversely proportional to frequency, and the phase shift is constant (—7/2) with frequency. 
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This result can be explained physically by recognizing that if a sinusoid cos wt is passed 
through an ideal integrator, the output is 2 sin wt = 2 cos (wt — $). Therefore, the 
amplitude response is inversely proportional to w, and the phase response is constant 
(-7/2) with frequency. 

Because its gain is 1/w, the ideal integrator suppresses higher-frequency components 
but enhances lower-frequency components with w < 1. Consequently, noise signals (if they 
do not contain an appreciable amount of very low frequency components) are suppressed 
(smoothed out) by an integrator. W 
A Exercise E7.1 

Find the response of an LTIC system specified by 
df 
dt 


dy | „dy 
—= +3— + 2y(t) = 
ae t dT u(t) 


if the input is a sinusoid 20 sin (3t + 35°) 


+ 5f(t) 


Answer: 10.23 sin (3t ~61.91°) Yy 


7.1-1 Steady-State Response to Causal Sinusoidal Inputs 

So far we discussed the LTIC system response to everlasting sinusoidal inputs 
(starting at t = —oo). In practice, we are more interested in causal sinusoidal inputs 
(sinusoids starting at t = 0). Consider the input e%* u(t), which starts at t = 0 
rather than at t = —oo. In this case F(s) = 1/(s + jw). Moreover, according to 
Eq. (6.51) H(s) = P(s)/Q(s), where Q(s) is the characteristic polynomial given by 
Q(s) = (s — A1)(s = Ag) +++ (s — An). Hence, 


P(s) 
(s = A1)(s = A2) +++ (s = An)(s — jw) 
In the partial fraction expansion of the right-hand side, let the coefficients cor- 


responding to the n terms (s — Ay), (s — Az)--- (s — An) be ki, k2, ++- kn. The 
coefficient corresponding to the last term (s — jw) is P(s)/Q(s)|s=j. = H(jw). 


Hence, 
ki H (jw 
¥(s)=) at Ge) 


Y(s) = F(s)H(s) = 


fel = Ài se jw 
and = 
y(t)=  Soketult) +  HGw)je u(t) (7.9) 
i=l a ee 


steady-state component ys. (t) 
transient component yer (t) 
For an asymptotically stable system, the characteristic mode terms e**' decay with 
time, and, therefore, constitute the so-called transient component of the response. 
The last term H(jw)e’* persists forever, and is the steady-state component of 
the response given by l 
Yss(t) = H (jw)e?* u(t) 

From the argument that led to Eq. (7.5a), it follows that for a causal sinusoidal 

input cos wt, the steady-state response yss(t) is given by 


yss(t) = |H (jw)| cos [wt + ZH (jw)lu(t) (7.10) 
In summary, |H (jw)| cos [wt + ZH (jw)] is the total response to everlasting sinusoid 
cos wt, and is also the steady-state response to the same input applied at t = 0. 
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7.2 Bode Plots 


Sketching frequency response plots is considerably facilitated by the use of ` 
logarithmic scales. The amplitude and phase response plots as a function of w on a 
logarithmic scale are known as the Bode plots. By using the asymptotic behavior 


of the amplitude and the phase response, we can sketch these plots with remarkable 
ease, even for higher-order transfer functions. 


Let us consider a system with the transfer function 
His) = K(s +a1)(s +42) 
s(s + b1)(s? + bos + bg) 


where the second-order factor (s? + bos + b3) is assumed to have complex conjugate 
roots. We shall rearrange Eq. (7.11a) in the form 


(7.11a) 


a3 2 (7.11b) 
1b3 (t) (E+ 2+1) 
and 1 Ea 
jw jw 
1+—)(i+ 
| 
H (jw) = T 1 n Gop (7.116) 
(1+2) [i+ — 
bi b3 b3 


This equation shows that H (jw) is a complex function ofw. The amplitude response 
|H (jw)| and the phase response LH (jw) are given by 


jw jw 
144]44 
HG _ Kaja2 | Sal t a 
|H (jw)] bibs z tw OF (7.12a) 
| heh z a 
1 b b3 


and 
LH (jw) = (1+ )ec(1+ 2) ~ Ljw 
ai a2 


ju jbow | (jw)? 
~Z(14+--)-2114 2" yp 
( e) | n t | (12) 


From Eq. (7.12b) we see that the phase function consists of the addition of only 
three kinds of terms: (i) the phase of jw, which is 90° for all values of w, (ii) 


the phase for the first-order term of the form 1 + hk and (iii) the phase of the 
second-order term i 


jbow (jw)? 
ie ee 
| b3 i b3 


We can plot these three basic phase functions for w in the range 0 to oo and then, 
using these plots, we can construct the phase function of any transfer by properly 
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adding these basic responses. Note that if a particular term is in the numerator, its 
phase is added, but if the term is in the denominator, its phase is subtracted. This 
makes it easy to plot the phase function ZH (jw) as a function of w. Computation 
of |H (jw)|, unlike that of the phase function, however, involves the multiplication 
and division of various terms. This is a formidable task, especially when we have 
to plot this function for the entire range of w (0 to 00). 

We know that a log operation converts multiplication and division to addition 
and subtraction. So, instead of plotting |H(jw)|, why not plot log |H(jw)| to 
simplify our task? We can take advantage of the fact that logarithmic units are 
desirable in several applications, where the variables considered have a very large 
range of variation. This is particularly true in frequency response plots, where we 
may have to plot frequency response over a frequency range starting from a very low 
frequency near 0 to a very high frequency in the range of 10?° or higher. A linear plot 
for such a large range will bury much of the useful information. Also, the amplitude 
response may have a very large dynamic range from a low of 10~® to a high of 10°. 
A linear plot would be unsuitable for such a situation. Therefore, logarithmic plots 
not only simplify our task of plotting, but, fortunately, they are also desirable in 
this situation. The logarithmic unit is the decibel and is equal to twenty times the 
logarithm of the quantity (log to the base 10). Therefore, 20log,) |H (jw)| is simply 
the log amplitude in decibels (dB). Thus, instead of plotting |H (jw)|,; we shall plot 
20log 19 |H (jw)| as a function of w. These plots (log amplitude and phase) are called 
Bode plots. For the transfer function in Eq. (7.12a), the log amplitude is 


. K 7 
20 log |H (jw}| = 20log #222 + 20108 1+ 2°) ~ 2010g [ju] 
b1b3 a2 


1+ Ë| + 20108 
ay 


` . PAT] 
1+ že] - 20tog)1 + e y e 
1 


— 20 log b3 bs 


(7.13) 


The term 20 log(.K a1a2/61b3) is a constant. We observe that the log amplitude is 
a sum of four basic terms corresponding to (i) a constant, (ii) a pole or zero at 
the origin (20 log |jw]|), (iii) a first-order pole or zero (20log|1 + jw/al), and (iv) 
complex conjugate poles or zeros (20 log {1 + jwb2/b3 + (jw)?/b3|). We can sketch 
these four basic terms as functions of w and use them to construct the log-amplitude 
plot of any desired transfer function. Let us discuss each of the terms. 

1. Constant ka,a2/b1b3 


The log amplitude of this term is also a constant, 20log(K a ,a2/b1b3). The 
phase contribution from this term is zero. 


2. Pole (or Zero) at the origin 
Log Magnitude 
Such a pole gives rise to the term —20 log |jw|, which can be expressed as 


—20 log |jw| = —20 log w 


20 log | H |, aB 7> 


Phase, degrees 
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This function can be plotted as a function of w. However, we can effect further 


simplification by using the logarithmic scale for the variable w itself. Let us define 
a new variable u such that 


Hence u = logw (7.14) 
—20logw = —20u (7.15a) 


The log-amplitude function —20u is plotted as a function of u in Fig. 7.3a. This 
is a straight line with a slope of —20. It crosses the u-axis at u=0. The w-scale 
(u = logw) also appears in Fig. 7.3a. Semilog graphs can be conveniently used for 
plotting, and we can directly plot w on semilog paper. A ratio of 10 is a decade 
and a ratio of 2 is known as an octave. Furthermore, a decade along the w-scale 
is equivalent to 1 unit along the u-scale. We can also show that a ratio of 2 (an 
octave) along the w-scale equals to 0.3010 (which is log; 2) along the u-scale.t 


30 


(u=-2) (u=-1) (u=0) (u=1) (u=2) 
Fig. 7.3 Amplitude and phase response of a pole or a zero at the origin. 


tThis point can be shown as follows: Let wy and w2 along the w-scale correspond to u and u2 
along the u-scale. Then logw; = u1, and logwz = ug. Then 


Thus, if u2 — u1 = logo w2 — logio w1 = logig(w2/ur) 
then (w2/w1)=10 (which is a decade) 

and if ug — u = logo 10 = 1 

thee (w2/w1) =2 (which is an octave) 


u2 — u1 = logy) 2 = 0.3010 
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Note that equal increments in u are equivalent to equal ratios on the w-scale. Thus, 
one unit along the u-scale is the same as one decade along the w-scale. This means 
that the amplitude plot has a slope of -20 dB/decade or —20(0.3010) = —6.02 
dB/octave (commonly stated as 6 dB/octave). Moreover, the amplitude plot crosses 
the w-axis at w = 1, since u = logjgw = 0 when w = 1. 

For the case of a zero at the origin, the log-amplitude term is 20 log w. This 
is a straight line passing through w = 1 and having a slope of 20 dB/decade (or 6 
dB/octave). This plot is a mirror image about the w-axis of the plot for a pole at 
the origin and is shown dotted in Fig. 7.3a. 


Phase 


The phase function corresponding to the pole at the origin is —Zjw [see Eq. 
(7.12b)]. Thus 


ZH (jw) = —Zjw = —90° (7.15b) 


The phase is constant (—90°) for all values of w, as depicted in Fig. 7.3b. For a 
zero at the origin, the phase is Ljw = 90°. This is a mirror image of the phase plot 
for a pole at the origin and is shown dotted in Fig. 7.3b. 


3. First-Order Pole (or Zero) 
The Log Magnitude 


The log amplitude because of a first-order pole at —a is —20 log h + at Let 


us investigate the asymptotic behavior of this function for extreme values of w 
(w <a and w > a). 
(a) Forw < a, 


—20 log 


t+ |x -a0l0g1 =0 (7.16) 


Hence, the log-armplitude function > 0 asymptotically for w < a (Fig. 7.4a). 
(b) For the other extreme case, where w > a, 


~20log|1 + 2 x% -2010( ©) (7.17a) 
a a 
= —20logw + 20 loga (7.17b) 
= —20u + 20loga 


This represents a straight line (when plotted as a function of u, the log of w) with 
a slope of —20 dB/decade (or ~6 dB/octave). When w = a, the log amplitude is 
zero (Eq. (7.17b)]. Hence, this line crosses the w-axis at w = a, as illustrated in Fig. 
7.4a. Note that the asymptotes in (a) and (b) meet at w = a. 

The exact log amplitude for this pole is 


2\3 
—20log}1 + 2] = -201og(1 + = 
a a 


w? 
= —10log ( + =) (7.18) 
a 


20 log | H I, dB 


Phase-———_»> 
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-45° 


-90° 


Fig. 7.4 Amplitude and phase response of a first-order pole or zero. 


This exact log magnitude function also appears in Fig. 7.4a. Observe that the actual 
plot and the asymptotic plots are very close. A maximum error of 3 dB occurs at 
w =a. This frequency is known as the corner frequency or break frequency. 
The error everywhere else is less than 3 dB. A plot of the error as a function of w is 
shown in Fig. 7.5a. This figure shows that the error at one octave above or below 
the corner frequency is 1 dB and the error at two octaves above or below the corner 
frequency is 0.3 dB. The actual plot can be obtained by adding the error to the 
asymptotic plot. 

The amplitude response for a zero at —a (shown dotted in Fig. 7.4a) is identical 
to that of the pole at —a witha sign change, and therefore is the mirror image (about 
the 0-dB line) of the amplitude plot for a pole at —a. 


Phase 


The phase for the first-order pole at —a is 


Error, db 


Phase error, degrees—> 


482 7 Frequency Response and Analog Filters 


0.0la 0.05a O.la 0.5a a Sa 10a 50a 100a 


Fig. 7.5 Errors in asymptotic approximation of a first-order pole. 


syne) =a (6) 


Let us investigate the asymptotic behavior of this function. For w <a, 


and, for w > a, 


The actual plot along with the asymptotes is depicted in Fig. 7.4b. In this case, we 
use a three-line segment asymptotic plot for greater accuracy. The asymptotes are 
(i) a phase angle of 0° for w < a/10, (ii) a phase angle of —90° for w > 10a, and 
a straight line with a slope —45°/decade connecting these two asymptotes (from 
w = a/10 to 10a) crossing the w axis at w = a/10. It can be seen from Fig. ia 
that the asymptotes are very close to the curve and the maximum error is 5.7°. A 
plot of the error as a function of w is illustrated in Fig. 7.5b. The actual plot can 
be obtained by adding the error to the asymptotic plot. The phase function for a 
pole at —a is shown in Fig. 7.4b. The phase for a zero at —a (shown dotted in Fig. 


errr annie ST TST 
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7.4b) is identical to that of the pole at —a with a sign change, and therefore is the 
mirror image (about the 0° line) of the phase plot for a pole at —a. 


4. Second-Order Pole (or Zero) 


Let us consider the second-order pole in Eq. (7.11a). The denominator term is 
s?+bos+b3. We shall introduce the often-used standard form s?+2¢ wns +w? instead 
of s? + bos + b3. With this form, the log amplitude function for the second-order 
term in Eq. (7.13) becomes 


PES 
-20 log |1 + 2j¢& + (£) (7.19a) 
Wn Wn 
and the phase function is 5 
-Z h +2 + (£) l (7.19b) 
Wn Wn 
The Log Magnitude 
The log amplitude is given by 
3 . w jw 2 
log amplitude = —20 log |1 + 25¢ (=) + (£) (7.20) 
Wn Wn 


For w & wn, the log amplitude becomes 


log amplitude ~ —20 log 1 = 0 (7.21) 


(-) 


= —40 logw — 40 logw, (7.22b) 


For w > wn, the log amplitude is 


log amplitude ~ —20 log = —40 log (=) (7.22a) 
w. 


n 


= —40u — 40 logwy, (7.22c) 


The two asymptotes are (i) zero for w < Wn, and (ii) -40u — 40logw, for w > 
wn. The second asymptote is a straight line with a slope of —40 dB/decade (or 
—12dB/octave) when plotted against the log w scale. It begins at w = wn [see Eq. 
(7.22b)]. The asymptotes are depicted in Fig. 7.6a. The exact log amplitude is 
given by [see Eq. (7.20)] 


21? 2 
log amplitude = —20 log i - (=) l +4? (=) (7.23) 
Wn Wn 
Clearly, the log amplitude in this case involves a parameter ¢. For each value of 
Ç, we have a different plot. For complex conjugate poles,t ¢ < 1. Hence, we must 
sketch a family of curves for a number of values of ¢ in the range 0 to 1. This 
is illustrated in Fig. 7.6a. The error between the actual plot and the asymptotes 


eee 
{For ¢ > 1, the two poles in the second-order factor are no longer complex but real, and each of 
these two real poles can be dealt with as separate first-order factors. 


cette pagename eid 
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— 
Oo 


20 log | H |, dB 
Oo 
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Fig. 7.6 Amplitude and phase response of a second-order pole. 


is shown in Fig. 7.7. The actual plot can be obtained by adding the error to the 
asymptotic plot. 

For second-order zeros (complex conjugate zeros), the plots are mirror images 
(about the 0-dB line) of the plots depicted in Fig. 7.6a. Note the resonance phe- 
nomenon of the complex conjugate poles. This phenomenon is barely noticeable for 
¢ > 0.707 but becomes pronounced as ¢ —> 0. 


Phase 


The phase function for second-order poles, as apparent in Eq. (7.19b), is 


Error, db 


Phase error, degrees 
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Fig. 7.7 Errors in the asymptotic approximation of a second-order pole. 


LH (jw) = —tan7? x (=) J = (S (7.24) 


LH (jw) = 0 


For w < wn, 


For w > wn, 
LH (jw) = —180° 


Hence, the phase + —180° as w — oo. As in the case of amplitude, we also have a 
family of phase plots for various values of ¢, as illustrated in Fig. 7.6b. A convenient 
asymptote for the phase of complex conjugate poles is a step function that is 0° for 
w < wn and —180° for w > wn. An error plot for such an asymptote is shown in 


Fig. 7.7 for various values of ¢. The exact phase is the asymptotic value plus the 
error, 
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For complex conjugate zeros, the amplitude and phase plots are mirror images 
of those for complex conjugate poles. We shall demonstrate the application of these 
techniques with two examples. 


@ Example 7.3 
Sketch the Bode plots for the transfer function 


20s(s + 100) 
(s + 2)(s + 10) 


First, we write the transfer function in normalized form 


H(s) = 


_ 20x 100 8 (1+ 785) 


H(s) = Jig Et) (7.25) 


axo We) O+H) GA) 


Here, the constant term is 100; that is, 40 dB (20 log 100 = 40). This term can be added 
to the plot by simply relabeling the horizontal axis (from where the asymptotes begin) as 
the 40 dB line (see Fig. 7.8a). Such a step implies shifting the horizontal axis upward by 
40 dB. This is precisely what is desired. 

In addition, we have two first-order poles at —2 and —10, one zero at the origin, and 
one zero at —100. 

Step 1. For each of these terms, we draw an asymptotic plot as follows (see Fig. 
7.8a): 

(i) For the zero at the origin draw a straight line with a slope of 20 dB/decade passing 
through w = 1, 

(ii) For the pole at —2, draw a straight line with a slope of -20 dB/decade (for w > 2) 
beginning at the corner frequency w = 2. 

(iii) For the pole at —10, draw a straight line with a slope of —20 dB/decade beginning 
at the corner frequency w = 10. 

(iv) For the zero at ~100, draw a straight line with a slope of 20 dB/decade beginning 
at the corner frequency w = 100. 

Step 2. Add all the asymptotes, as depicted in Fig. 7.8a. 

Step 3. Apply the following corrections (see Fig. 7.5a): 

(i) The correction at w = 1 because of the corner frequency at w = 2 is -1 dB. The 
correction at w = 1 because of the corner frequencies at w = 10 and w = 100 are quite 
small (see Fig. 7.5a) and may be ignored. Hence, the net correction at w = 1 is —1 dB. 

(ii) The correction at w = 2 because of the corner frequency at w = 2 is —3 dB, 
and the correction because of the corner frequency at w = 10 is —0.17 dB. The correction 
because of the corner frequency w = 100 can be safely ignored. Hence the net correction 
at w = 2 is —3.17 dB. 

(iii) The correction at w = 10 because of the corner frequency at w = 10 is —3 dB, 
and the correction because of the corner frequency at w = 2 is —0.17 dB. The correction 
because of w = 100 is 0.04 dB and may be ignored. Hence the net correction at w = 10 is 
—3.17 dB. 

(iv) The correction at w = 100 because of the corner frequency at w = 100 is 3 dB, 
and the corrections because of the other corner frequencies may be ignored. 

(v) The corrections at w = 4 and w = 5 (because of corner frequencies at w = 2 and 
10) are found to be about —1.75 dB each. 

With these corrections, the resulting amplitude plot is illustrated in Fig. 7.8a. 


Phase Plots 


We draw the asymptotes corresponding to each of the four factors: 
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Fig. 7.8 Amplitude and phase response of the second-order system in Example 7.3. 


(i) The zero at the origin causes a 90° phase shift. 

(ii) The pole at s = —2 gives rise to a —45°/decade asymptote starting at w = 0.2, 
which goes up to w = 20. For w < 0.2, the asymptote is 0°, and, for w > 20, the asymptotic 
value is —90°. 

(iii) The pole at s = —10 has an asymptote with a zero value for ~oo < w < 1 and a 
slope of —45°/decade beginning at w = 1 and going up to w = 100. The asymptotic value 
for w > 100 is —90°. 

(iv) The zero at s = —100 gives rise to an asymptote with a 45°/decade slope, 
beginning at w = 10 and going up to w = 1000. For w < 10, the asymptotic value is 0°, 
and, for w > 1000, the asymptotic value is 90°. All the asymptotes are added, as shown 
in Fig. 7.8b. The appropriate corrections are applied from Fig. 7.5b, and the exact phase 
plot is depicted in Fig. 7.8b. W 
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E Example 7.4 
Sketch the amplitude and phase response (Bode plots) for the transfer function 


1+ as) 
H(s) = 10(s + 100) i ( 100 


= = 7.26 
s2? + 2s + 100 145+ (7:20) 


Here, the constant term is 10; that is, 20 dB (20 log 10 = 20). To add this term, we 
simply label the horizontal axis (from where the asymptotes begin) as the 20 dB line as 
before(see Fig. 7.9a). 

In addition, we have a real zero at s = —100 and a pair of complex conjugate poles. 
When we express the second-order factor in standard form, * 


s? + 2s +100 = 5? + 2wns + w? 
we have 
Wn = 10 and ¢=01 


Step 1. Draw an asymptote of —40 dB/decade (12 dB/octave) starting at w = 10 
for the complex conjugate poles, and draw another asymptote of 20 dB/decade, starting 
at w = 100 for the (real) zero. 

Step 2. Add both asymptotes. 

Step 3. Apply the correction at w = 100, where the correction because of the corner 
frequency w = 100 is 3 dB. The correction because of the corner frequency w = 10 may be 
ignored. Next, apply the correction at w = 10, where the correction because of the corner 
frequency w = 10 is 13.90 dB (see Fig. 7.7a for ¢ = 0.1 ). We may find corrections at a 
few more points. The resulting plot is illustrated in Fig. 7.9a. 


Phase Plot 


The asymptote for the complex conjugate poles is a step function with a jump of 
—90° at w = 10, and the asymptote for the zero at s = —100 is a straight line with a slope 
of 45°/decade, leveling off at w = 10 and w = 100 to 0° and 90°, respectively. The two 
asymptotes add to give the sawtooth shown in Fig. 7.9b. We now apply the corrections 
from Fig. 7.7b and Fig. 7.5b to obtain the exact plot. E 


© Computer Example C7.2 

Solve Examples 7.3 and 7.4 using M-file functions in MATLAB. 

Frequency response may be plotted using several functions. For the purpose of Bode 
plots, however, the most suitable file is bode.m, which can be used as demonstrated here. 


% For Example 7.3 

num=[20 2000 0};den=[1 12 20}; 
bode(num,den) 

% For Example 7.4 

num=[0 10 1000];den=(1 2 100}; 
bode(num,den) ©) 


Poles and Zeros in RHP 


In our discussion so far, we have assumed the poles and zeros of the transfer 
function to be in the LHP. What if some of the poles and/or zeros of H (s) lie in the 
RHP? If there is a pole in the RHP, the integral in Eq. (2.49) with s = jw does not 
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Fig. 7.9 Amplitude and phase response of a second-order system in Example 7.4. 


pre 
a 


(+5) 


Therefore, the log amplitude plots remain unchanged whether the zero(s) are in the 
LHP or the RHP. However, the phase of the RHP zero at s = a is 


Ljw — a) = L — (a — jw) = r + tan”! (=) = 7 — tan”! (2) 
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whereas the phase of the LHP pole at s = ~a is ~ tan~! (w/a). 

The complex conjugate zeros in RHP give rise to a term s? — 2Çwns +w2, which 
is identical to the term s? + 2¢wns + w?2 with a sign change in ¢. Hence, from Eqs. 
(7.23) and (7.24) it follows that the amplitudes are identical, but the phases are of 
opposite signs for the two terms. 


7.2-1 The Transfer Function From the Frequency Response 


In the previous section we were given the transfer function of a system. From 
a knowledge of the transfer function, we developed techniques for determining the 
system response to sinusoidal inputs. We can also reverse the procedure to deter- 
mine the transfer function of a system if the system response to a sinusoidal input is 
known. This problem has significant practical utility. If we are given a system in a 
black box with only the input and output terminals available, the transfer function 
has to be determined by experimental measurements at the input and output ter- 
minals. The frequency response to sinusoidal inputs is one of the possibilities that 
is very attractive because of the simple nature of the measurements involved. One 
only needs to apply a sinusoidal signal at the input and observe the output. We find 
the amplitude gain |H (jw)| and the output phase shift ZH (jw) (with respect to the 
input sinusoid) for various values of w over the entire range from 0 to oo. This in- 
formation yields the frequency response plots (Bode plots) when plotted against log 
w. From these plots we determine the appropriate asymptotes by taking advantage 
of the fact that the slopes of all asymptotes must be multiples of +20 dB/decade if 
the transfer function is a rational function (function which is not necessarily a ratio 
of two polynomials in s). From the asymptotes, the corner frequencies are obtained. 
Corner frequencies determine the poles and zeros of the transfer function. 


7.3 Control System Design Using Frequency Response 


Figure 7.10a shows a basic closed-loop system, whose open-loop transfer func- 
tion (transfer function when the loop is opened) is KG(s)H(s). The closed-loop 
transfer function is {see Eq. (6.69) 


KG(s) 


T(s) = TT KG) Hs) 


The time-domain method of control system design discussed in Sec. 6.7 works only 
when the transfer function of the plant (the system to be controlled) is known and is 
a rational function (ratio of two polynomials in s). The input-output description of 
practical systems is often unknown and is more likely to be nonrational. A system 
containing an ideal time delay (dead time) is an example of a nonrational system. 
In such cases, we can determine the frequency response of the open-loop system 
empirically and use this data to design the (closed-loop) system. In this section 
we shall discuss feedback system design procedure based on frequency response 
description of a system. However, the frequency response design method is not as 
convenient as the time-domain design method from the viewpoint of the transient 
and the stead y-state error specifications. Consequently, the time-domain method in 
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Sec. 6.7 and the frequency response method should be considered as complementary 
rather than as alternatives or as rivals. 

Frequency response information can be presented in a various forms of which 
Bode plot is one. The same information can be presented by the Nyquist plot” 
also known as the polar plot or by the Nichols plot also known as log-magnitude 
versus angle plot. Here, we shall discuss the techniques using Bode and Nyquist 
plots only. Figure 7.10b shows Bode plots for the open-loop transfer function 
K/s(s+2)(s+4) when K = 24. The same information is presented in polar form in 
the corresponding Nyquist plot in Fig. 7.10c. For example, at w = 1, |H (jw)| = 2.6 
and ZH (jw) = —130.6°. We plot a point at a distance 2.6 units and at an angle 
—130.6° from the horizontal axis. This point is labeled as w = 1 for identification 
(see Fig. 7.10c). We plot such points for several frequencies in the range from w = 0 
to oo and draw a smooth curve through them to obtain the Nyquist plot. The same 
information is presented in Cartesian form in Nichols plot. For instance, at w = 1, 
the log magnitude is 20 log 2.6 = 8.3 dB, and the phase at w = 1 is —130.6°. We 
plot a point at coordinates x = 8.3, y = —130.6° and label this point as w = 1 for 
identification. We do this for several values of w from 0 to oo and draw a curve 
through these points to obtain Nichols plot. Using Bode or Nyquist (or Nichols) 
plots of the open-loop transfer function, we can readily investigate stability aspect 
of the corresponding closed-loop system as discussed below. 


7.3-1 Relative Stability: Gain and Phase margins 


For the system in Fig. 7.10a, the characteristic equation is 1+ KG(s)H(s) =0 
and the characteristic roots are the roots of KG (s)H (s) = —1. The system becomes 
unstable when the root loci cross over to RHP. The crossing occurs on the imaginary 


axis where s = jw (see Fig. 6.43). Hence, at the verge of instability (marginal 
stability) 


KG(jw)H (jw) = -1 = 1e*™ 


Thus, at the verge of instability, the magnitude and angle of the open loop gain 
KG(jw)H (jw) are 


|KG(jw)H(jw)|=1, and G(jw)H(jw) = +r 


Thus, on the verge of instability, the open-loop transfer function has unity gain 
and phase of +7. In order to understand the significance of these conditions, let us 
consider the system in Fig. 7.10a, with open-loop transfer function K /s(s+2)(s +4). 
The Bode plot for this transfer function (for K = 24) is depicted in Fig. 7.10b. The 
root locus for this system is illustrated in Fig. 6.43. The loci cross over to RHP 
for K > 48. For K < 48, the system is stable. Let us consider the case K = 24. 
Figure 7.10b shows Bode plots when K = 24. Let the frequency where the angle 
plot crosses —180° be wp (the phase crossover frequency). Observe that at wp, 
the gain is 0.5 or —6 dB. This shows that the gain K will have to double (to value 
48) to have unity gain, which is the verge of instability. For this reason we say that 
the system has a gain margin œm = 6 dB. On the other hand, if w, is the frequency 
where the gain is unity or 0 dB, (the gain crossover frequency), then at this 
frequency, the open-loop phase is —157.5°. The phase will have to decrease from 
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this value to —180° before the system becomes unstable. Thus, the system has a 
phase margin of 8m = 22.5°. Clearly, the gain and phase margins are measures of 
relative stability of the system. z 
Figure 7.10c shows that the Nyquist plot of KG (s)H(s) crosses the real axis 

at —0.5 for K = 24. If we double K to a value 48, the magnitude of every point 
doubles (but the phase is unchanged). This step expands the Nyquist plot by a 
factor 2. Hence, for K = 48, the Nyquist plot lies on the real axis at —1; that 
is, KG(jw)H (jw) = —1, and the system becomes unstable. For K > 48, the plot 
Gin Grossdyer Reagan crosses and goes beyond the point —1. Thus, the critical point —1 lies inside the 
@,= 1.9 curve; that is, the curve encircles the critical point —1. When the Nyquist plot 

of an open-loop transfer function encircles the critical point —1, the corresponding 
closed-loop system becomes unstable. This statement, roughly speaking, is the well- 
known Nyquist criterion in a simplified form.{ For the Nyquist plot in Fig. 7.10b 


Y(s) 


(a) 


(a) Gain margin = 6 dB (for K = 24), the gain will have to double before the system becomes unstable. 

-12 + Thus, the gain margin is 2 (6 dB)in this case. In general, if the Nyquist plot crosses 

the negative real axis at —am, then the gain margin is 1/a.. Similarly, if =r + êm 

-24 + is the angle at which the Nyquist plot crosses the unit circle, the phase margin is 
aaga ©) 9m. In the present case, 8m = 22.5°. 


In order to protect a system from instability because of variations in system 
parameters (or in the environment), the system should be designed with reasonable 
gain and phase margins. Small margins indicate that the poles of the closed-loop 
system are in the LHP, but too close to the jw axis. The transient response of such 
systems will have a large overshoot (PO). On the other hand, very large (positive) 
gain and phase margins may indicate a sluggish system. Generally, a gain margin 
higher than 6 dB and a phase margin of about 30° to 60° are considered desirable. 
Design specifications for transient performance are often given in terms of gain and 
phase margins. 


Phase margin = 22.5° NY 
-180° 


Phase crossover frequency 
@, = 2. 


me 7.3-2 Transient Performance in Terms of Frequency Response 


For a second-order system in Eq. (6.81), we saw the dependence of the transient 
response (PO, t,, tg and ts) on the dominant pole location. Using this knowledge, 
we developed in Sec. 6.7 a procedure for designing a control system for a specified 
transient performance. In order to develop such a procedure from the knowledge 

Re —> of system’s frequency response (rather than its transfer function), we must know 
ae the relationship between the frequency response and the transient response of the 
system in Eq. (6.81). Figure 7.11 shows the frequency response of a second-order 

ee, system in Eq. (6.81). The peak frequency response M, (the maximum value of 

i the amplitude response), which occurs at frequency wp, indicates relative stability 

of the system. Higher peak response generally indicates smaller Ç (see Fig. 7.6a), 

(c) which implies poles closer to the imaginary axis, and less relative stability. Higher 

Ne Mp also means higher PO (the step response overshoot). Generally acceptable 
values of M, in practice range from 1.1 to 1.5. The 3-dB bandwidth wa of the 
frequency response indicates the speed of the system. We can show that wy and t, 


GH plane 


The Nyquist criterion states as follows: A closed curve Cs in the s plane enclosing m zeros and 
n poles of an open-loop transfer function W(s) maps into a closed curve Cw in the W plane 
encircling the origin of the W plane m — n times, in the same direction as that of Cs. lfn—mis 
negative, then the encirclement is in the opposite direction. 


. : 4 
Fig. 7.10 Gain and Phase margins of a system with open-loop transfer function ICTD 
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Fig. 7.11 Frequency response of a second-order system. 


are inversely proportional. Hence, higher wp indicates smaller t, (faster response). 
For the second-oder system in Eq. (6.81), we have 

2 

n 


(jw)? +2jlwnw + w2 
To find Mp, we let d|T(jw)|/dw = 0. From the solution of this equation, we find 


T (jw) = a 


¢ < 0.707 


TEES. 
P gi- 
wp = wn y1 — ¢? ç < 0.707 


pay [a — 2¢2) + VILKO a] (7.27) 


These equations show that we can determine ¢ and wn from Mp and wy. Knowledge 40 -3.0 -2.0 -1.0 05 0 1.0 
of ¢ and wn allow us to determine the transient parameters, such as, PO, t, and 
ts as seen from Eqs. (6.83), (6.84) and (6.85). Conversely, if we are given certain 
transient specifications PO, t,, and ts, we can determine the required M, and wp. 
Thus, the problem now reduces to designing a system, which has a certain Mp 
and wp for the closed-loop frequency response. In practice, we know the open- 
loop system frequency response. So the ultimate problem reduces to relating the 
frequency response of the closed-loop system to that of the the open-loop system. 
To do this, we shall consider the case of unity feedback system, where the feedback 
transfer function is H (s) = 1.t The closed-loop transfer function in this case is 


(a) 


KG 
T(s) = _KC(s) 

1+ KG(s) (b) 

and 
, KG(jw 
T(jw) = Teu 

1+ KG(jw) 

Let 
T (jw) = Mei), and KG(jw) = 2(w) + jy(w) 

{The results for the unity feedback can be extended to nonunity feedback systems. Fig. 7.12 Relationship between the open-loop and the closed-loop frequency response. 
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Consequently 
o+jy 


Mele) = 
l+atjy 


Straightforward manipulation of this equation yields 


2 \2 2 
2+ pg E 
M?—1 (M? — 1)? 


This is an equation of a circle centered at [- 7%, 0] and of radius 744 in 
the KG(jw) plane. Figure 7.12a shows circles for various values of M. Because 
M is the closed-loop system amplitude response, these circles are the contours of 
constant amplitude response of the closed-loop system. For example, the point 
A = —2 — 1.85 lies on the circle M = 1.3. This means, at a frequency where the 
open-loop transfer function is G(jw) = —2 — 71.85, the corresponding closed-loop 
transfer function amplitude response is 1.3. 

To obtain t he closed-loop frequency response, we superimpose on these contours 
the Nyquist plot of the open-loop transfer function KG(jw). For each point of 
KG(jw), we can determine the corresponding value of M, the closed-loop amplitude 
response. From similar contours for constant a (the closed-loop phase response), 
we can determine the closed loop phase response. Thus, the complete closed-loop 
frequency response can be obtained from this plot. We are primarily interested 
in finding Mp, the peak value of M and wp, the frequency where it occurs. Figure 
7.12b indicates how these values may be determined. The circle to which the Nyquist 
plot is tangent corresponds to Mp, and the frequency at which the Nyquist plot is 
tangential to this circle is wp. For the system, whose Nyquist plot appears in Fig. 
7.12b, Mp = 1.6 and wp = 2. From these values, we can estimate Ç and wn, and 
determine the transient parameters PO, t, and ts. 

In designing systems, we first determine Mp and wp required to meet the given 
transient specifications from Eqs. (7.27). The Nyquist plot in conjunction with M 
circles suggests how these values of M, and w, may be realized. In many cases, a 
mere change in gain K of the open-loop transfer function will suffice. Increasing K 
expands the Nyquist plot and changes the values Mp and wp correspondingly. If this 
is not enough, we should consider some form of compensation such as lag and/or 
lead networks. Using a computer, one can quickly observe the effect of particular 
form of compensation on Mp and wp. 


7.4 Filter Design by Placement of Poles and Zeros OF H(s) 


In this section we explore the strong dependence of frequency response on the 
location of poles and zeros of H(s). This dependence points to a simple intuitive 
procedure to filter design. A systematic filter design procedure to meet given spec- 
ifications is discussed later in Secs. 7.5, 7.6, and 7.7. 


7.4-1 Dependence of Frequency Response on poles and Zeros of H(s) 


Frequency response of a system is basically the information about the filtering 
capability of the system. We now examine the close connection that exists between 


{We can find similar contours for constant @ (the closed-loop phase response). 
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Fig. 7.13 (a)vector representation of complex numbers (b) vector representation of factors 
of H(s). 


the pole-zero locations of a system transfer function and its frequency response (or 
filtering characteristics). A system transfer function can be expressed as 


Hlo) = PO a 5, {= le = #2)“ (6 = en) 
Q(s) (s ~ A1)(s — A2) +++ (8 — An) 
where z1, z2, ..., Zn are the zeros of H (s) and the characteristic roots \1, A2,..., 


An are the poles of H(s). Now the value of the transfer function H(s) at some 
frequency s = p is 


(7.28a) 


-p = 21)(p — 22) +++ (p-n) 
H(Mowp = Paty aa)ip— da) (P= An) 
This equation consists of factors of the form p — z; and p — d;. The factor p — z is a 
complex number represented by a vector drawn from point z to the point p in the 
complex plane, as illustrated in Fig. 7.13a. The length of this line segment is |p — z|, 
the magnitude of p — z. The angle of this directed line segment (with horizontal 
axis) is 4(p — z). To compute H (s) at s = p, we draw line segments from all poles 
and zeros of H(s) to the point p, as shown in Fig. 7.13b. The vector connecting 
a zero z; to the point p is p — z;. Let the length of this vector be r;, and let its 
angle with the horizontal axis be ¢;. Then p — z; = r;ef®i. Similarly, the vector 
connecting a pole \; to the point p is p— Ay = dje?%, where d; and 6; are the length 
and the angle (with the horizontal axis), respectively, of the vector p — ài. Now 
from Eq. (7.28b) it follows that 


(7.28b) 


(riei? \(rge9?) --- (rnet?) 
(dye991)(dze99?) .. . (d,,e791) 


= bp 2 Tm pilli tor++ón)-(01+82+:::+0n)] 


H (s)ls=p = bn 


Therefore dida: -dn 
TIT2'': Tn 
H =p = bn — 
| (s)ls=p "didz dh 


product of the distances of zeros to p 


~ "product of the distances of poles to p (7:293) 
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and 
4H(s)| op = (1 + G2 +: +n) — (01 +02 +--+ 8n) 
= sum of zero angles to p — sum of pole angles to p (7.29b) 


Using this procedure, we can determine H (s) for any value of s. To compute the 
frequency response H (jw), we use s = jw (a point on the imaginary axis), connect 
all poles and zeros to the point jw, and determine |H (jw)| and ZH (jw) from Eqs. 
(7.29). We repeat this procedure for all values of w from 0 to oo to obtain the 
frequency response. 
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Fig. 7.14 The role of poles and zeros in determining the frequency response of an LTIC 
system. 


Gain Enhancement by a Pole 


To understand the effect of poles and zeros on the frequency response, consider 
a hypothetical case of a single pole ~a + jwo, as depicted in Fig. 7.14a. To find 
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the amplitude response |H (jw)| for a certain value of w, we connect the pole to the 
point jw (Fig. 7.14a). If the length of this line is d, then |H (jw)| is proportional to 
1/d. . 


Gu) = Ž (7.30) 


where the exact value of constant K is not important at this point. As w increases 
from zero up, d decreases progressively until w reaches the value wo. As w in- 
creases beyond wo, d increases progressively. Therefore, according to Eq. (7.30), 
the amplitude response |H (jw)| increases from w = 0 until w = wo, and it decreases 
continuously as w increases beyond wọ, as illustrated in Fig. 7.14b. Therefore, a 
pole at —a + jwo results in a frequency-selective behavior that enhances the gain at 
the frequency wo (resonance). Moreover, as the pole moves closer to the imaginary 
axis (as a is reduced), this enhancement (resonance) becomes more pronounced. 
This is because a, the distance between the pole and jwo (d corresponding to jwo), 
becomes smaller, which increases the gain K /d. In the extreme case, when a = 0 
(pole on the imaginary axis), the gain at wo goes to infinity. Repeated poles further 
enhance the frequency-selective effect. To summarize, we can enhance a gain at a 
frequency wo by placing a pole opposite the point jwo. The closer the pole is to jwo, 
the higher is the gain at wo, and the gain variation is more rapid (more frequency- 
selective) in the vicinity of frequency wo. Note that a pole must be placed in the 
LHP for stability. 

Here we have considered the effect of a single complex pole on the system gain. 
For a real system, a complex pole —a+jwo must accompany its conjugate —a —jwo. 
We can readily show that the presence of the conjugate pole does not appreciably 
change the frequency-selective behavior in the vicinity of wo. This is because the 
gain in this case is K/dd', where d’ is the distance of a point jw from the conjugate 
pole ~a — jwo. Because the conjugate pole is far from jwo, there is no dramatic 
change in the length d’ as w varies in the vicinity of wo. There is a gradual increase 
in the value of d’ as w increases, which leaves the frequency-selective behavior as it 
was originally, with only minor changes. 


Gain Suppression by a Zero 

Using the same argument, we observe that zeros at —a + jwo (Fig. 7.14d) will 
have exactly the opposite effect of suppressing the gain in the vicinity ofwo, as shown 
in Fig. 7.14e). A zero on the imaginary axis at jwo will totally suppress the gain 
(zero gain) at frequency wo. Repeated zeros will further enhance the effect. Also, 
a closely-placed pair of a pole and a zero (dipole) tend to cancel out each other's 
influence on the frequency response. Clearly, a proper placement of poles and zeros 
can yield a variety of frequency-selective behavior. Using these observations, we 
can design lowpass, highpass, bandpass, and bandstop (or notch) filters. 

Phase response can also be computed graphically. In Fig. 7.14a, angles formed 
by the complex conjugate poles —a + jwo at w = 0 (the origin) are equal and 
opposite. As w increases from 0 up, the angle 6; because of the pole —a + jwo, 
which has a negative value at w = 0, is reduced in magnitude; the angle 62 because 
of the pole —a — jwo, which has a positive value at w = 0, increases in magnitude. 
As a result, 6, +82, the sum of the two angles, increases continuously, approaching a 
value 7 as w — oo. The resulting phase response LH (jw) = —(6; +82) is illustrated 
in Fig. 7.14c. Similar arguments apply to zeros at -a + jwo. The resulting phase 
response ZH (jw) = ($1 + $2) is depicted in Fig. 7.14f. 
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We now focus on simple filters, using the intuitive insights gained in this dis- 
cussion. The discussion is essentially qualitative. 


7.4-2 Lowpass Filters 


A typical lowpass filter has a maximum gain at w = 0. Therefore, we need to 
place a pole (or poles) on the real axis opposite the origin (jw = 0), as shown in 
Fig. 7.15a. The transfer function of this system is 


H(s) = 2e 


swe 


We have chosen the numerator of H (s) to be we in order to normalize the de gain 
H (0) to unity. If d is the distance from the pole —we to a point jw (Fig. 7.15a), 
then 

w= 2 

lH (jw)| = 7 

with H(0) = 1. As w increases, d increases and |H (jw)| decreases monotonically 
with w, as illustrated in Fig. 7.15d by label n = 1. This is clearly a lowpass filter 
with gain enhanced in the vicinity of w = 0. 


Xo jo, 
n=5 
0 Re > 
Wai -jo, 
(c) 


lH gol 


(d) 


Fig. 7.15 Pole-zero configuration and the amplitude response of a lowpass (Butterworth) 
filter. 
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Wall-to-wall Poles R 

An ideal lowpass filter characteristic (shaded) in Fig. 7.15d, has a constant 
gain of unity up to frequency we. Then the gain drops suddenly to 0 for w > We. 
To achieve the ideal lowpass characteristic, we need enhanced gain over the entire 
frequency band from 0 to we. We know that to enhance a gain at any frequency w, 
we need to place a pole opposite w. To achieve an enhanced gain for all frequencies 
over the band (0 to We), we need to place a pole opposite every frequency in this 
band. In other words, we need a continuous wall of poles facing the imaginary 
axis opposite the frequency band 0 to We (and from 0 to —w, for conjugate poles), 
as depicted in Fig. 7.15b. At this point, the optimum shape of this wall is not 
obvious because our arguments are qualitative and intuitive. Yet, it is certain that 
to have enhanced gain (constant gain) at every frequency over this range, we need 
an infinite number of poles on this wall. We can show that for a maximally flat} 
response over the frequency range (0 to wc), the wall is a semicircle with an infinite 
number of poles uniformly distributed along the wall.) In practice, we compromise 
by using a finite number (n) of poles with less-than-ideal characteristics. Figure 
7.15¢ shows the pole configuration for a fifth-order (n = 5) filter. The amplitude 
response for various values of n are illustrated in Fig. 7.15d. As n — oo, the filter 
response approaches the ideal. This family of filters is known as the Butterworth 
filters. There are also other families. In Chebyshev filters, the wall shape is a 
semiellipse rather than a semicircle. The characteristics of a Chebyshev filter are 
inferior to those of Butterworth over the passband (0, we), where the characteristics 
show a rippling effect instead of the maximally flat response of Butterworth. But in 
the stopband (w > we), Chebyshev behavior is superior in the sense that Chebyshev 
filter gain drops faster than that of the Butterworth. 


t 
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(a) (b) 
Fig. 7.16 Pole-zero configuration and the amplitude response of a bandpass filter. 
7.4-3 Bandpass Filters 


The shaded characteristic in Fig. 7.16b shows the ideal bandpass filter gain. 
In the bandpass filter, the gain is enhanced over the entire passband. Our earlier 


tMaximally flat amplitude response means the first 2n — 1 derivatives of |H(jw)| are zero at w = 0. 
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(a) (b) 


Fig. 7.17 Pole-zero configuration and the amplitude response of a bandstop (notch) filter. 


discussion indicates that this can be realized by a wall of poles opposite the imagi- 
nary axis in front of the passband centered at wo. (There is also a wall of conjugate 
poles opposite —wo.) Ideally, an infinite number of poles is required. In prac- 
tice, we compromise by using a finite number of poles and accepting less-than-ideal 
characteristics (Fig. 7.16). 


7.4-4 Notch (Bandstop) Filters 


An ideal notch filter amplitude response (shown shaded in Fig. 7.17b) is a 
complement of the amplitude response of an ideal bandpass filter. Its gain is zero 
over a small band centered at some frequency wo and is unity over the remaining 
frequencies. Realization of such a characteristic requires an infinite number of poles 
and zeros. Let us consider a practical second-order notch filter to obtain zero gain at 
a frequency w = wo. For this purpose we must have zeros at + jwo. The requirement 
of unity gain at w = oo requires the number of poles to be equal to the number 
of zeros (m = n). This ensures that for very large values of w, the product of the 
distances of poles from w will be equal to the product of the distances of zeros from 
w. Moreover, unity gain at w = 0 requires a pole and the corresponding zero to 
be equidistant from the origin. For example, if we use two (complex conjugate) 
zeros, we must have two poles; the distance from the origin of the poles and of 
the zeros should be the same . This requirement can be met by placing the two 
conjugate poles on the semicircle of radius wo, as depicted in Fig. 7.17a. The poles 
can be anywhere on the semicircle to satisfy the equidistance condition. Let the 
two conjugate poles be at angles +6 with respect to the negative real axis. Recall 
that a pole and a zero in the vicinity tend to cancel out each other’s influences. 
Therefore, placing poles closer to zeros (selecting 6 closer to 7 /2) results in a rapid 
recovery of the gain from value 0 to 1 as we move away from wọ in either direction. 
Figure 7.17b shows the gain |H(jw)| for three different values of 0. 


E Example 7.5 
Design a second-order notch filter to suppress 60 Hz hum in a radio receiver. 
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We use the poles and zeros in Fig. 7.17a with wo = 1207. The zeros are at s = tjwo. 
The two poles are at —wo cos 9 + jwosin 8. The filter transfer function is (with wo = 1207) 


H(s) = (s — jwo)(s + jwo) 
(s + wocos 8 + jwo sin 8)(s + wo cos 6 — jw sin 8) 
2 tug 5? + 142122.3 
= -r = eee 
s? + (2wo cos 6)s +wg s? + (753.98 cos 0)s + 142122.3 


and 
—w? + 142122.3 


|H (Gw)| = = 
V (~w? + 142122.3)? + (753.98w cos 8)? 


The closer the poles are to the zeros (closer the @ to 5), the faster the gain recovery from 
0 to 1 on either side of wo = 1207. Figure 7.17b shows the amplitude response for three 
different values of 8. This example is a case of very simple design. To achieve zero gain 
over a band, we need an infinite number of poles as well as of zeros. W 


© Computer Example C7.3 
Plot the amplitude response of the transfer function 


7 s ug 
8? + (2wo cos 8)s + w3 


H(s) 


of a second order notch filter for wo = 1207 and 6 = 60°, 80°, and 87°. 


w0=120* pi; 

theta=[60 80 87]*(pi/180); 

for m=1:length(theta) 
num=[1 0 w0*2}; 
den=[1 2*w0*cos(theta(m)) w0* 2); 
w=0:.5:1000; w=w’; 
{mag,phase,w]=bode(num,den,w); 
plot(w,mag),hold on,axis({0 1000 0 1.1)) 

end 


Figures 7.16b and 7.17b show that a notch (stopband) filter frequency response 
is a complement of the bandpass filter frequency response. If H Bp(s) and Hgs(s) 
are the transfer functions of a bandpass and a bandstop filter (both centered at the 
same frequency), then 


Hps(s) =1- Hgp(s) 
Therefore, a bandstop filter transfer function may also be obtained from the corre- 
sponding bandpass filter transfer function. The case of lowpass and highpass filters 


is similar. If Hp p(s) and Hyp(s) are the transfer functions of a lowpass and a 
highpass filter respectively (both with the same cutoff frequency), then 


Hyp(s) =1- Hrp(s) 


Therefore, a highpass filter transfer function may also be obtained from the corre- 
sponding lowpass filter transfer function. 
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A Exercise E7.2 
Using the qualitative method of sketching the frequency response, show that the system with 


the pole-zero configuration in Fig. 7.18a is a highpass filter, and that with the configuration in 
Fig. 7.18b is a bandpass filter. VW 


s plane 


Im 


-00 


(a) (b) 


Fig. 7.18 Pole-zero configuration of a highpass filter in Exercise E7.2. 


7.4-5 Practical Filters and Their Specifications 


For ideal filters everything is black and white; the gains are either zero or unity 
over certain bands. As we saw earlier, real life does not permit such a world view. 
Things have to be gray or shades of gray. In practice, we can realize a variety of 
filter characteristics which can only approach ideal characteristics. 

An ideal filter has a passband (unity gain) and a stopband (zero gain) with 
a sudden transition from the passband to the stopband. There is no transition 
band. For practical (or realizable) filters, on the other hand, the transition from 
the passband to the stopband (or vice versa) is gradual, and takes place over a finite 
band of frequencies. Moreover, for realizable filters, the gain cannot be zero over 
a finite band (Paley-Wiener condition). As a result, there can no true stopband 
for practical filters. We therefore define a stopband to be a band over which the 
gain is below some small number G's, as illustrated in Fig. 7.19. Similarly, we define 
a passband to be a band over which the gain is between 1 and some number 
Gp (Gp < 1), as shown in Fig. 7.19. We have selected the passband gain of unity 
for convenience, It could be any constant. Usually the gains are specified in terms 
of decibels. This is simply 20 times the log (to base 10) of the gain. Thus 


G(dB) = 20 logy) G 


A gain of unity is 0 dB and a gain of V2 is 3.01 dB, usually approximated by 3 dB. 
Sometimes the specification may be in terms of attenuation, which is the negative of 
the gain in dB. Thus a gain of 1/v2; that is, 0.707, is —3 dB, but is an attenuation 
of 3 dB. 

In our design procedure we assume that Gp (minimum passband gain) and 
G, (maximum stopband gain) are specified. Figure 7.19 shows the passband, 
the stopband, and the transition band for typical lowpass, bandpass, highpass, and 
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(c) (d) 
Fig. 7.19 Passband, stopband, and transitionband in various types of filters. 


bandstop filters. In this chapter we shall discuss the design procedures for these 
four types of filters. Fortunately, the highpass, bandpass, and bandstop filters can 
be obtained from a basic lowpass filter by simple frequency transformations. For 
example, replacing s with we/s in the lowpass filter transfer function results in a 
highpass filter. Similarly, other frequency transformations yield the bandpass and 
bandstop filters. Hence, it is necessary to develop a design procedure only for a basic 
lowpass filter. Using appropriate transformations, we can then design other types 
of filters. We shall consider here two well known families of filters: the Butterworth 
and the Chebyshev filters. 


7.5 Butterworth Filters 


The amplitude response |H (jw)| of an nth order Butterworth lowpass filter is 
given by 


AG = — 

|H (ju) = (7.31) 
1+ (2) 

Observe that at w = 0, the gain |H (j0)] is unity and at w = we, the gain |H (jwe)! = 


1/V2 or —3 dB. The gain drops by a factor V2 at w = we. Because the power 
is proportional to the amplitude squared, the power ratio (output power to input 
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o> 
Fig. 7.20 Amplitude response of a normalized lowpass Butterworth filter. 


power) drops by a factor 2 at w = we. For this reason we is called the half-power 
frequency or the 3 dB-cutoff frequency (amplitude ratio of V2 is 3 dB). 


Normalized Filter 


In the design procedure it proves most convenient to consider a normalized 
filter H(s), whose half-power frequency is 1 rad/s (we = 1). For such a filter, the 
amplitude characteristic in Eq. (7.31) reduces to 


1 
Vitam 


We can prepare a table of normalized transfer functions H(s) which yield the fre- 
quency response in Eq. (7.32) for various values of n. Once the normalized transfer 
function is obtained, we can obtain the desired transfer function H (s) for any value 
of we by simple frequency scaling, where we replace s by s/w, in the normalized 
H(s). 

The amplitude response |H(jw)| of the normalized lowpass Butterworth filters 
is depicted in Fig. 7.20 for various values of n. From Fig. 7.20 we observe the 
following: 


H(jw)| = (7.32) 


1. The Butterworth amplitude response decreases monotonically. Moreover, the 
first 2n — 1 derivatives of the amplitude response are zero at w = 0. For 
this reason this characteristic is called maximally flat at w = 0. Observe 
that a constant characteristic (ideal) is maximally flat for all w < 1. In the 
Butterworth filter we try to retain this property at least at the origin. 


2. The filter gain is 1 (0 dB) at w = 0 and 0.707 (-3 dB) at w = 1 for all n. 
Therefore, the 3-dB (or half power) bandwidth is 1 rad/s for all n. 


3. For large n, the amplitude response approaches the ideal characteristic. 
To determine the corresponding transfer function H(s), recall that H(— jw) is 
the complex conjugate of H(jw). Therefore 
1 


: , on 
Hjw)H(—jw) = |HGw)|* = ear 


{Butterworth filter exhibits maximally flat characteristic also at w = 00. 
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Fig. 7.21 Poles of a normalized even-order lowpass Butterworth Filter transfer function 
and its conjugate. 


Substituting s = jw in this equation, we obtain 


1 
H(s)H(-s) = IFG” 
The poles of H(s)H(—s) are given by 
32” = —(j)*" 


In this result we use the fact that —1 = ef7(2k-1) for integral values of k, and 
j = e3"/? to obtain 


s?” = efT(k-1+n) integer 
This equation yields the poles of H(s)H(—s) as 
sp = ea (2ktn-1) k =1,2,3,..., 2n (7.33) 


Observe that all poles have a unit magnitude; that is, they are located on a unit 
circle in the s-plane separated by angle m/n, as illustrated in Fig. 7.21 for odd 
and even n. Since H(s) is stable and causal, its poles must lie in the LHP. The 
poles of H(—s) are the mirror images of the poles of H(s) about the vertical axis. 
Hence, the poles of H(s) are those in the LHP and the poles of H(—s) are those 
in the RHP in Fig. 7.21. The poles corresponding to H(s) are obtained by setting 
k=1, 2,3,...,n in Eq. (7.33); that is 


Sk = efi (2k+n-1) 
=cos —(2k +n — 1) +jsin —(2k+n-1) k=1,2,3,...,n (7.34) 
2n 2n 


and H(s) is given by 
1 


(s ~ 81)(s = s2)---(s — sn) 


H(s) = (7.35) 
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(a) (b) (c) (d) 


Fig. 7.22 Poles of a normalized lowpass Butterworth filter of various orders. 


For instance, from Eq. (7.34), we find the poles of H(s) for n = 4 to be at angles 
52/8, 7x /8, 97/8, and 117/8. These lie on the unit circle, as shown in Fig. 7.22, and 
are given by —0.3827 + 30.9239, —0.9239 + 0.3827. Hence, H(s) can be expressed 
as 


1 
(s + 0.3827 — j0.9239)(s + 0.3827 + 30.9239)(s + 0.9239 — 70.3827)(s + 0.9239 + 70.3827) 
1 
(s2 + 0.76548 + 1)(s? + 1.84788 + 1) 
E 1 
~ 8442613183 + 3.414282 + 2.61318 + 1 


H(s) = 


We can proceed in this way to find H(s) for any value of n. In general 
1o 1 
Bals) s” +4y-18"-! +--+ ais +1 


where B,,(s) is the Butterworth polynomial of the nth order. Table 7.1 shows the 
coefficients a), a2, ..., dn—2, @n—1 for various values of n; Table 7.2 shows Br(s) in 
factored form. In these Tables, we read for n = 4 


(7.36) 


H(s) = 


1 
s4 + 2.613183 + 3.414282 + 2.61315 + 1 
= 1 
~ (s2 + 0.76548 + 1)(s? + 1.8478s + 1) 


H(s) = 


a result, which confirms our earlier computations. 

We can also find the normalized Butterworth filter transfer function using 
MATLAB function [z,p,k]=buttap(n) to find poles,zeros and the gain factor of a 
normalized nth-order Butterworth filter. 


© Computer Example C7.4 
Using MATLAB, find poles, zeros, and the gain factor of a normalized 4th-order 
Butterworth filter. 


[z,p,k]=buttap(4) 
MATLAB returns poles, zeros, and the gain factor k, which is unity for all orders. © 
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Frequency Scaling 

Although Tables 7.1 and 7.2 are for normalized Butterworth filters with 3 dB 
bandwidth w, = 1, the results can be extended to any value of we by simply replacing 
s by s/w. This step implies replacing w by w/w, in Eq. (7.32). For example, the 
second-order Butterworth filter for we = 100 can be obtained from Table 7.1 by 
replacing s by s/100. This step yields 

1 

2 
(180) + V2 (385) +1 
2 1 

s? + 100V2s + 104 


H(s) = 


(7.37) 


The amplitude response |H (jw)| of the filter in Eq. (7.37) is identical to that 
of normalized |H(jw)| in Eq. (7.32), expanded by a factor 100 along the horizontal 
(w) axis (frequency scaling). 


Determination of n, the Filter Order 


If G, is the gain of a lowpass Butterworth filter in dB units at w = wz, then 
according to Eq. (7.31) 


2n 
Gz = 20 logy |H (jws)| = —10log i + (2) | 


We 


Substitution of the specifications in Fig. 7.19a (gains Gp at wp and G, at we) in this 
equation yields 


or 
w 2n A 
(=) = 107/10} (7.38a) 
We 
7 Qn ? 
@ = 1907O#/10 (7.38b) 
We 


and 


log (107.710 a 1) / (20-@e710 = 1)] 


.39 
2 log(ws/wp) (7.39) 


n= 
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Also from Eq. (7.38a) 


Wp 


We = - i7an (7.40) 
[1076+710 — 1 
Alternatively, from Eq. (7.38b) 
me we (7.41) 


n 1/2 
[10-0 — a] ee 


a Example 7.6 
Design a Butterworth lowpass filter to meet the specifications (Fig. 7.23): 


(i) Passband gain to lie between 1 and Gp = 0.794 (Gp = —2dB) for0 < w < 10. 
(ii) Stopband gain not to exceed Gs = 0.1(Gs = —20dB) forw > 20. 


Step 1: Determine n : 
Here wp = 10, ws = 20, Gp = —2 dB, and G, = —20 dB. Substituting these values in 
Eq. (7.39) yields 
n = 3.701 
Since n can only be an integer, we choose 
n=4 


Step 2: Determine we 
Substitution of n = 4, wp = 10 in Eq. (7.40) yields 


we = 10.693 
Alternately, substitution of n = 4 in Eq. (7.41) yields 


we = 11.261 


Because we selected n = 4 rather than 3.701, we obtain two different values of we. 
Choice of we = 10.693 will satisfy exactly the requirement Gp = 0.794 over the 
passband (0, 10), and will surpass the requirement Gs = 0.1 in the stopband w > 20. 
On the other hand, choice of we = 11.261 will exactly satisfy the requirement on G, 
but will oversatisfy the requirement for Gp. Let us choose the former case (we = 
10.693). 
Step 3: Determine the normalized transfer function H(s) 
The normalized fourth-order transfer function H(s) is found from Table 7.1 as 


1 
84 + 2.613153 + 3.414282 + 2.61318 +1 
Step 4: Determine the final filter transfer function H (s) 
The desired transfer function with we = 10.693 is obtained by replacing s with 
s/10.693 in the normalized transfer function H(s) as 


1 
(1040s) + 2.6131 (zpSq5)° + 3.4142 (7o57) + 2.6131 ($s) +1 


7 13073.7 
~ s4 + 27.94283 + 390.48? + 3194.88s + 13073.7 
T 13073.7 

~ (8? + 8.18445 + 114.34)(s? + 19.7585 + 114.34) 


H(s) = 


H(s) = 
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0 10 20 


@, = 10.693 


Fig. 7.23 Amplitude response of the lowpass Butterworth filter in Example 7.6. 


The amplitude response of this filter is given by Eq. (7.31) with n = 4 and we = 10.693 


1 
(e3) + 1 


Figure 7.23 shows the amplitude response of this filter. 


|HGw)| = 


We could also have used the alternate value of we = 11.261. This choice would result 


in a slightly different design. Either of the two designs satisfies the specifications. 


© 


Computer Example C7.5 
Solve Example 7.6 using MATLAB 


% Step 1: Determine n 
wp=10; ws=20; Gp=-2; Gs=-20; 
P1=-Gs/10; P2=-Gp/10; Wsp=ws/wp; 
nc=log((10°P1-1)/(10°P2-1))/(2*log(Wsp)); 
n=ceil(nc); 
% Step 2: Determine Wc (option that satisfies passband requirement 
% exactly and may oversatisfy stopband requirement). 
We=wp/(10°P2-1)*(1/(2*n)); 
% Step 3: Determine the normalized transfer function H(s) 
for k=1:n 

A=(2*(k-1)+n+1)/(2*n); 

Sk=cos(A*pi)+j*sin(A*pi); 

s=[s Sk]; 
end 
s=s’; 
numi=[(0 1]; denl=poly((s’}); 
% Step 4: Determine the final filter transfer function H(s) 
num2=[0 Wen}; den2=poly(We*{s’]); 
fprintf(’Filter Order is n = %i\n’,n) 
fprintf(’Cutoff Frequency of the Filter is We = %.4f\n’,Wc) 
disp(’Poles of the transfer function are’),s 
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disp(’The normalized fourth-order transfer function is’) 
printsys(abs(num1),abs(den1)) 

disp(’The transfer function with s replaced by s/Wc is’) 
printsys(abs(num2),abs(den2)) 

% Step 5: Amplitude response of the filter 

w=0:.01:40; w=w’; 

[mag,phase,w]=bode(num2,den2,w); 

plot(w,mag) 

Filter Order isn = 4 

Cutoff Frequency of the Filter is Wc = 10.6934 

Poles of the transfer function are 

8 = -0.3827 - 0.92391 

-0.9239 - 0.3827i 

-0.9239 + 0.3827i 

-0.3827 + 0.92391 

The normalized fourth-order transfer function is 


1 
s°4 + 2.613 s°3 + 3.414 s°2 + 2.613s +1 


The transfer function with s replaced by s/Wce is 


num/den = 13:000 ©) 
i s°4 + 27.94 s°3 + 390.4 s°2 + 3195 s + 1.3 e+004 


num/den = 


Using M-files from MATLAB Signal Processing Toolbox 
We can also compute the desired filter transfer function using appropriate M- 
files from the Signal Processing Toolbox as shown in the next few examples. 


© Computer Example C7.6 
Using M-file functions in MATLAB, design a lowpass Butterworth filter to meet the 
specifications in Example 7.6. 


Wp=10;Ws=20;Gp=-2;Gs=-20; 
{n,Wc]=buttord(Wp, Ws,-Gp,-Gs,’s’); 
{num,den]=butter(n,Wc,’s’); 


Here num and den are the coefficients of the numerator and the denominator poly- 
nomials of the desired filter. In this example, the matlab answer is n + 1 element vectors 
asnum=0 0 0 0 16081 and den= 1 29 433 3732 16081; that is, 


16081 


H(s) = 739959 4 433s? 4 37320 + 16081 


This is the alternate solution where the passband specifications are exceeded, but the 
stopband specifications are satisfied exactly. On the other hand, the solution in Example 
C7.5 exceeds the stopband specifications, but satisfies the passband specifications exactly 
because of use of Eq. (7.40) {rather than Eq. (7.41)]. To plot amplitude response, we can 
use the last three functions from Example C7.5. © 


A Exercise E7.3 

. Determine N, the order of the lowpass Butterworth filter to meet the following specifications: 
Gp = —0.5dB, Gs = —20 dB, wp = 100, and ws = 200. 

Answer: 5. V7 
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7.6 Chebyshev Filters 


The amplitude response of a normalized Chebyshev lowpass filter is given by 
A 1 
IH(jw)| = ~ (7.42) 
1+ eC,7(w) 


where C,,(w), the nth-order Chebyshev polynomial, is given by 


Calw) = cos (n cos! w) (7.43a) 
An alternative expression for Cp (w) is 
Cn(w) = cosh (n cosh™! w) (7.43b) 


The form (7.43a) is most convenient to compute Caw) for |w] < 1 and form 
(7.43b) is convenient for computing Cn(w) for |w] > 1. We can show! that Crlw) 
is also expressible in polynomial form, as shown} in Table 7.3 for n = 1 to 10. 

The normalized Chebyshev lowpass amplitude response [Eq. (7.42)] is depicted 
in Fig. 7.24 for n = 6 and n = 7. We make the following general observations: 


Table 7.3: Chebyshev Polynomials 


er 


n Crlw) 
eee 

01 

l w 

2 Qw?-1 

3 4w’ — 3w 

4 8w4 ~ 8w? +1 

5 16w® — 20w3 + 5w 

6 32w® — 484 4 18w? — 1 

7 64w? — 112w> + 56w? — Tw 

8 1288 — 256w® + 160w4 — 32w? + 1 

9 256w? — 576w7 + 432w5 — 120w3 + 9w 

10 512w1° — 1280w8 + 1120w® — 400w4 + 50w? — 1 


nnn EE 


{The Chebyshev polynomial Cn (w) has the property! 
Cw) = WwCa-1(w) —Ca-alw) n>2 


Thus, knowing that 
Cow) =1 and Ci(w) = w 


we can construct Cy, (w) for any value of n. For example, 


Calw) = 2wC1(w) — Co(w) = Qw* -1 


and so on. 
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Fig. 7.24 Amplitude response of normalized sixth- and seventh-order lowpass Chebyshev 
filters. 


1. The Chebyshev amplitude response has ripples in the passband and is smooth 
(monotonic) in the stopband. The passband is 0 < w < 1, and there is a total 
of n maxima and minima over the passband 0 < w < 1. 


2. From Table 7.3, we observe that 


0 n odd 
c2(0) = (7.44) 
1 n even 
Therefore, the de gain is 
1 n odd 
|H(0)| = : (7.45) 
n even 
1+e 


3. The parameter e controls the height of ripples. In the passband, r, the ratio of 
the maximum gain to the minimum gain is 


r=V1l+ée? (7.46a) 


This ratio r, specified in decibels, is 


î = Wlog V1 + e? = 10logig(1 + €?) (7.46b) 
so that 
e = 107/10 _ 1 (7.47) 


Because all the ripples in the passband are of equal height, the Chebyshev 
polynomials C,,(w) are known as equal-ripple functions. 


4. The ripple is present only over the passband 0 < w < 1. At w = 1, the ampli- 
tude response is 1/ V1 +€? = 1/r. For w > 1, the gain decreases monotonically. 

5. For Chebyshev filters, the ripple f dB takes the place of Gp (the minimum gain 
in the passband). For example, 7 < 2 dB specifies that the gain variations of 
more than 2 dB cannot be tolerated in the passband. In the Butterworth filter 
Gp = —2 dB means the same thing. 


6. If we reduce the ripple, the passband behavior improves, but it does so at 
the cost of stopband behavior. As r is decreased (e is reduced), the gain in 
the stopband increases, and vice-versa. Hence, there is a tradeoff between the 
allowable passband ripple and the desired attenuation in the stopband. Note 
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that the extreme case e = 0 yields zero ripple, but the filter now becomes an 
allpass filter, as seen from Eq. 7.42, by letting e = 0. 


7. Finally, the Chebyshev filter has a sharper cutoff (smaller transition band) 
than the same-order Butterworth filter,t but this is achieved at the expense of 
inferior passband behavior (rippling). 


Determination of n (Filter Order) 7 
For a normalized Chebyshev filter, the gain G in dB [see Eq. (7.42)] is 
G = —10log [1 + Cn? (w)] 


The gain is G s at ws. Therefore 


Gg = —10 log [1 + Cn? (ws)] (7.48) 
or 


On? (ws) = 1078/10 — 1 


Use of Eq. (7.43b) and Eq.(7.47) in the above equation yields 


A 1/2 
107G:/10 _ 1 
cosh [n cosh™*(ws)] = | | 


107/10 -1 
Hence 
a 1/2 
1078/10 — 1 
= = | > 7.49 
ý cosh“! (ws) costi | 107/10 — 1 (7.49a) 


Note that these equations are for normalized filters, where wp = 1. For a general 
case, we replace w, with FE to obtain 


107/10 — 1 


5 1/2 
10—G+/10 _ 1 
n = — c cosh™ | (7.49b) 
cosh" (ws/wp) 


Pole Locations 

We could follow the procedure of the Butterworth filter to obtain the pole 
locations of the Chebyshev filter. The procedure is straightforward but tedious and 
does not yield any special insight into our development. The Butterworth filter 
poles lie on a semicircle. We can show that the poles of an nth-order normalized 
Chebyshev filter lie on a semiellipse of the major and minor semiaxes cosh z and 
sinh z, respectively, where! 


pm Senet () (7.50) 
n E 


The Chebyshev filter poles are 
- 2k—1 
sk = — sin ja sinh z + j cos [E] coshgs k=1,2,---,n (7.51) 
2n 2n 


{We can show? that at higher frequencies (in the stopband), the Chebyshev filter gain is smaller 
than the comparable Butterworth filter gain by about 6(n — 1) dB. 
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Fig. 7.25 Poles of a normalized third-order lowpass Chebyshev filter transfer function 
and its conjugate. 


The geometrical construction for determining the pole location is depicted in Fig. 
7.25 for n = 3. A similar procedure applies to any n; it consists of drawing two 
semicircles of radii a = sinh z and b = cosh z. We now draw radial lines along 
the corresponding Butterworth angles and locate the nth-order Butterworth poles 
(shown by crosses) on the two circles. The location of the kth Chebyshev pole is 
the intersection of the horizontal projection and the vertical projection from the 
corresponding kth Butterworth poles on the outer and the inner circle, respectively. 
The transfer function H(s) of the normalized nth-order lowpass Chebyshev 
filter is 
Kn Kn 
ma C'als) > s” + Gn—sP-} +. + ais + ao (7.52) 
The constant Kpn is selected to have proper dc gain, as shown in Eq. (7.45). Asa 
result 


ao n odd 
Kr= ao _ 4 (7.53) 
Vara = 597720 n even 


The design procedure is considerably simplified by ready-made tables of the 
polynomial C’,(s) in Eq. (7.52) or the pole locations of H(s). Table 7.4 lists the co- 
efficients ag, a1, a2, --+, an—1 of the polynomial C(s) in Eq. (7.52) for f = 0.5, 1, 2, 
and 3 dB ripples corresponding to the values of e = 0.3493, 0.5088, 0.7648, and 
0.9976, respectively. Table 7.5 lists the poles of various Chebyshev filters for the 
same values of f (and e). Tables listing more extensive values of f (or €) can be 
found in the literature. We can also use MATLAB functions for this purpose. 


© Computer Example C7.7 
Using MATLAB, find poles, zeros, and the gain factor of a normalized 3rd-order 
Chebyshev filter with 7 = 2 dB. 


[z,p,k]=cheblap(3,2) © 
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Table 7.5: Chebyshev Filter Pole Locations 


a 
n #=05 f=1 f=2 ies 


eee 


Table 7.4: Chebyshev Filter Coefficients of the Denominator Polynomial 
Ch(s) = 8" +an_18"7) + a, 98-2 +... + ais + ag 


—2.8628 


— 1.9652 


— 1.3076 


—1.0024 


2 —0.7128 + j1.0040 —0.5489 + j0.8951 —0.4019 + j0.8133 —0.3224 + j0.7772 
—_— U 
E SE 3 —0.6265 —0.4942 —0.3689 —0.2986 
: 0.5 db ripple = 1. = (0. 0. + 40.92 _0. (0. 
SL 15169026: ADEGE ape 0.3132 + 71.0219 0.2471 + 70.9660 0.1845 + 70.9231 0.1493 + 50.9038 
3 0.7156938 1.53 : 
10370050G ieee Resets aanseeke 4 —0.1754+ 51.0163  —0.1395 + j0.9834 —0.1049 + j0.9580 —-0.0852 + 50.9465 
5 0.1789234 0.7525181 13095747 19373675 1.1724909 ~0.4233 + 50.4209  —0.3369 + j0.4073 —0.2532 + 70.3968 + —0.2056 + 70.3920 
6 0.0947626 0.4323669 1.1718613 1.5897635 2.1718446 1.1591761 
7 0.047309 0.2820722 0.7556511 1.6479029 1.8694079 2.4126510 —‘1.1512176 5 —0.3623 — 0.2895 — 0.2183 —0.1775 
—0.1120+ 71.0116 —0.0895 + 0.9901  —0.0675 + 50.9735  —0.0549 + 70.9659 
amie 
L Paes 6 —0.0777 + 51.0085  —0.0622 + j0.9934  -0.0470+ j0.9817 —0.0382 + 50.9764 
Sethe ie ae -0.2121 + 70.7382  —0.1699 + 0.7272  -0.1283 + j0.7187  —0.1044 + 70.7148 
s : f= n 4 A n 
3 0,4913067 12384092 0.9883412 —0.2898 + j0.2702 —0.2321 + j0.2662 —0.1753 + j0.2630 —0.1427 + j0.2616 
4 0.2756276 0.7426194 1.4539248 0.9528114 
5 0.1228267 0.5805342 0.9743961 1.6888160 0.9368201 T 30.250257 -0.2054 E0953: t =0;1265. | 
6 0.0689069 0.3070808 0.9393461 1.2021409 1.9308256 0.9282510 ~0.0570 + j1.0064 —0.0457 + j0.9953 —0.0346 + j0.9866 —0.0281 + j0.9827 
7 0.0307066 0.2136712 0.5486192 1.3575440 1.4287930 2.1760778  0.9231228 ~0.1597 + j0.8071 —0.1281 + j0.7982 —0.0969 + j0.7912 -0.0789 + j0.7881 
~0.2308 + j0.4479 —0.1851 + j0.4429 —0.1400 + j0.4391 —0.1140 + j0.4373 
ee 
8 —0.0436 + j1.0050 —0.0350 + j0.9965 —0.0265 + j0.9898 -0.0216 + j0.9868 
ss asori l —0.1242 + j0.8520 —0.0997 + j0.8447 —0.0754 + j0.8391 —0.0614 + j0.8365 
5 O o2s00i O SUr ie A ~0.1859 + 0.5693  —0.1492 + j0.5644 —0.1129 + j0.5607 —0.0920 + 70.5590 
3 0.3268901 10221903 0.7378216 —0.2193 + 50.1999  —0.1760 + 0.1982  -0.1332 + j0.1969 —0.1085 + 70.1962 
4 0.2057651 0.5167981 1.2564819 0.7162150 
5 0.0817225 0.4593491 0.6934770 1.4995433 0.7064606 9 —0.1984 —0.1593 ~0.1206 —0.0983 
6 0.0514413 0.2102706 0.7714618 0.8670149 1.7458587 0.7012257 —0.0345 + 71.0040 = -0.0277+ j0.9972  -0.0209 + j0.9919 —0.0171 + j0.9896 
7 0.0204228 0.1660920 0.3825056 1.1444390 1.0392203 1.9935272 0.6978929 —0.0992 + 30.8829 —0.0797 + j0.8769 —0.0603 + 50.8723 ~0.0491 + 70.8702 
0.1520 + j0.6553  —0.1221 + j0.6509 —0.0924 + j0.6474 — —0.0753 + 0.6459 
E —0.1864 + j0.3487 —0.1497 + 70.3463 —0.1134 + 70.3445 —0.0923 + 50.3437 
Loses aes 10 —0.0279 + j1.0033  -0.0224+ 70.9978  —0.0170+ j0.9935 —0.0138 + 70.9915 
07079478 0.6448996 G= 3) e -0.0810 + j0.9051 —0.1013 + j0.7143 —0.0767 + j0.7113 —0.0401 + j0.8945 
0.2505943 0.9283480 0.5972404 —0.1261 + j0.7183 —0.0650 + j0.9001 —0.0493 + j0.8962 —0.0625 + j0.7099 
~0.1589 + j0.4612 —0.1277 + j0.4586 —0.0967 + j0.4567 —0.0788 + j0.4558 


0.0626391 0.4079421 0.5488626 1.4149874 0.5744296 
0.0442467 0.1634299 6990977 6906098 1.6628481 0.5706979 
0.0156621 0.1461530 0.3000167 1.0518448 0.8314411 1.9115507 0.5684201 


a EE 


1 

2 

3 

4 0.1769869 0.4047679 1.1691176 0.5815799 
5 

6 

7 


—0.1761 + 70.1589 


—0.1415 + 70.1580 


—0.1072 + 70.1574 


—0.0873 + 70.1570 


nn eee 
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Fig. 7.26 Amplitude response of the lowpass Chebyshev filter in Example 7.7. 


E Example 7.7 

Design a Chebyshev lowpass filter to satisfy the following criteria (Fig. 7.26): 

_ The ratio # < 2 dB over a passband 0 < w < 10 (wp = 10). The stopband gain 
Gs < —20 dB for w > 16.5 (ws = 16.5). 

Observe that the specifications are the same as those in Example 7.6, except for the 
transition band. Here the transition band is from 10 to 16.5, whereas in Example 7.6 it 
is 10 to 20. Despite this stringent requirement, we shall find that Chebyshev requires a 
lower-order filter than the Butterworth filter found in Example 7.6. 


Step 1: Determining n 
According to Eq. (7.49b), we have 


1/2 
1 -ı | 10?-1 
aab A] | = 2.99 
"= cosh™*(1.65) O Es =i 2:299 


Because n must be an integer, we select n = 3. Observe that even with more stringent 
requirements, the Chebyshev filter requires only n = 3. The passband behavior of 
the Butterworth filter, however, is superior (maximally fiat at w = 0) compared to 
that of the Chebyshev, which has rippled passband characteristics. 


Step 2: Determining H(s) 
We may use the Table 7.4 to determine H(s). For n = 3 and # = 2 dB, we read 
the coefficients of the denominator polynomial of H(s) as ao = 0.3269, a1 = 1.0222, 
and a2 = 0.7378. Also in Eq. (7.53), for odd n, the numerator is given by a constant 
Kn = ao = 0.3269. Therefore, 


0.3269 
s3 + 0.73785? + 1.02228 + 0.3269 


Because there are infinite possible combinations of n and ê, Table 7.4 (or 7.5) can list 
values of the denominator coefficients for values of ê in quantum increments only.! 
For the values of n and 7 not listed in the Table, we can compute pole locations 
from Eq. (7.51). For the sake of demonstration, we now recompute H(s) using this 
method. In this case, the value of e is [see Eq. (7.47)| 


e = y 10°/10 — 1 = 1/1092 — 1 = 0.7647 


H(s) = (7.54) 
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From Eq. (7.50) 


1 a 
¢=—sinh7? 1 = I sinh“? (1.3077) = 0.3610 

n e 3 
Now from Eq. (7.51), we have sı = —0.1844 + j0.9231, s2 = —0.3689, and s3 = 
—0.1844 — j0.9231. Therefore 


Kn 
ee Bn en E 
(s + 0.3689)(s + 0.1844 + j0.9231)(s + 0.1844 — 70.9231) 
z Kn _ 0.3269 
8° + 0.73785? + 1.02225 + 0.3269 5° + 0.737852 + 1.02228 + 0.3269 


H(s) 


which confirms the earlier result. 

Step 3: Determining H(s) 
Recall that wp = 1 for the normalized transfer function. For wp = 10, the desired 
transfer function H(s) can be obtained from the normalized transfer function H(s) 
by replacing s with s/wp = s/10. Therefore 


0.3269 
(75 + 0.3689) (<5 + 0.1844 + 70.9231)(% + 0.1844 — 70.9231) 


D 326.9 
~ 83 + 7.3788? + 102.228 + 326.9 


H(s) = 


In the present case, f = 2 dB means that [see Eq. (7.47)} 


é = 10°? — 1 = 0.5849 
The frequency response is [see Eq. (7.42) and Table 7.3] 


f 1 
KGw)| = ——— 
1 + 0.5849(4w3 — 3w)? 


This is the normalized filter amplitude response. The actual filter response |H(jw)| 


is obtained by replacing w with oni that is, with 7 in H(jw) 


|H(jw)| = : 


1 + 0.5849 [4 ()° - 3 (%)°] 
10° 


V9.3584w — 1403.76w4 + 52640w2 + 106 


Observe that despite more stringent specifications than those in Example 7.6, the 
Chebyshev filter requires n = 3 compared to the Butterworth filter in Example 7.6, which 
requires n = 4. Figure 7.26 shows the amplitude response. E 


© Computer Example C7.8 
Design a lowpass Chebyshev filter for the specifications in Example 7.7 using functions 
from Signal Processing Toolbox in MATLAB. 


Wp=10;Ws=16.5;r=2;Gs=-20; 
[n, Wp]=cheblord(Wp, Ws,r,-Gs,’s’); 
{num,den]=cheby1(n,r,Wp,’s’); 
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MATLAB returns n = 3 and num= 0 0 0 326.8901, den= 1 7.3782 102.219 
326.8901; that is, 
326.8901 


s3 + 7.37828? + 102.2198 + 326.8901 


a result, which agrees with the solution in Example 7.7. To plot amplitude response, we 
can use the last three functions from Example C7.5. (©) 


H(s) = 


A Exercise E7.4 
_ Determine Te, the order of the lowpass Butterworth filter to meet the following specifications: 
Gp = —0.5dB, Gs = —20dB, wp = 100, and ws = 200. 
Answer: 5. 7 
A Exercise E7.5 
Determine n (the order) and the transfer function of a Chebyshev filter to meet the following 
specifications: f = 2 dB, Gs = —20 dB, wp = 10 rad/s, and ws = 28 rad/s. 
Answer: n = 2 
_ 50.5823 oe 50.5823 
~ (8+ 4.0191 + 76.8937)(s + 4.0191 — 76.8937) 5? + 8.03815 + 63.6768 


Hint: In this case Ko = Jz vd 


A(s) 


7.6-1 inverse Chebyshev Filters 


The passband behavior of the Chebyshev filters exhibits ripples and the stop- 
band is smooth. Generally, passband behavior is more important and we would 
prefer that the passband have smooth response. However, ripples can be tolerated 
in the stopband as long as they meet a given specification. The inverse Cheby- 
shev filter does exactly that. Both, the Butterworth and the Chebyshev filters, have 
finite poles and no finite zeros, The inverse Chebyshev has finite zeros and poles. 
It exhibits maximally flat passband response and equal-ripple stopband response. 

The inverse Chebyshev response can be obtained from the Chebyshev in two 
steps as follows: Let Hc(w) be the Chebyshev amplitude response given in Eq. 
(7.42). In the first step, we subtract |Hc(w)|* from 1 to obtain a highpass filter 
characteristic where the stopband (from 0 to 1) has ripples and the passband (from 
1 to oo) is smooth. In the second step, we interchange the stopband and passband 
by frequency transformation where w is replaced by 1/w. This step inverts the 
passband from the range 1 to oo to the range 0 to 1, and the stopband is now from 
1 to oo. Moreover, the passband is now smooth and the stopband has ripples. This 
is precisely the inverse Chebyshev amplitude response |H(w)| given by 


C2 (1/w 
MP = 1 folijo) = Sate 
where Cy(w) are the nth-order Chebyshev polynomials listed in Table 7.3. 

The inverse Chebyshev filters are preferable to the Chebyshev filters in many 
ways. For example, the passband behavior, especially for small w, is better for 
the inverse Chebyshev than for the Chebyshev or even for the Butterworth filter 
of the same order. The inverse Chebyshev also has the smallest transition band 
of the three filters. Moreover, the phase function (or time-delay) characteristic 
of the inverse Chebyshev filter is better than that of the Chebyshev filter.2 Both 
the Chebyshev and inverse Chebyshev filter require the same order n to meet a 


7.6 Chebyshev Filters 523 


given set of specifications.1 But the inverse Chebyshev realization requires more 
elements and thus is less economical than the Chebyshev filter. But the inverse 
Chebyshev does require fewer elements than a comparable performance Butterworth 
filter. Rather than give complete development of inverse Chebyshev filters, we shall 
solve a problem using MATLAB functions from the Signal Processing Toolbox. 


© Computer Example C7.9 
Design a lowpass inverse Chebyshev filter for the specifications in Example 7.7, using 
functions from Signal Processing Toolbox in MATLAB. 


Wp=10;Ws=16.5;Gp=-2;Gs=-20; 
[n,Ws]=cheb2ord(Wp,Ws,-Gp,-Gs,’s’); 
{num ,den}=cheby2(n,-Gs,Ws,’s’) 
MATLAB returns n = 3 and num= 0 5 0 1805.9, den= 1 23.2 256.4 1805.9; that 
1s, 
5s? + 1805.9 
s3 + 23.25? + 256.48 + 1805.9 


To plot amplitude response, we can use the last three functions from Example C7.5. © 


H(s) = 


7.6-2 Elliptic Filters 


Recall our discussion in Sec. 7.4 that placing a zero on the imaginary axis (at 
s = jw) causes the gain (|H (jw)}) to go to zero (infinite attenuation). We can realize 
a sharper cutoff characteristic by placing a zero (or zeros) near w = ws. Butterworth 
and Chebyshev filters do not make use of zeros in H(s). But an elliptic filter does. 
This is the reason for the superiority of the elliptic filter. 

A Chebyshev filter has a smaller transition band compared to that of a Butter- 
worth filter because a Chebyshev filter allows rippling in the passband (or stopband). 
If we allow ripple in both the passband and the stopband, we can achieve further 
reduction in the transition band. Such is the case with elliptic (or Cauer) filters, 
whose normalized amplitude response is given by 


H(jw)| = l 


1+ e?Rn (w) 

where Rn(w) is the nth-order Chebyshev rational function determined from the 
specific ripple characteristic. The parameter e controls the ripple. The gain at wp 
(wp = 1 for the normalized case) is = i 

The elliptic filter is the most efficient if we can tolerate ripples in both the 
passband and the stopband. For a given transition band, it provides the largest 
ratio of the passband gain to stopband gain, or for a given ratio of passband to 
stopband gain, it requires the smallest transition band. In compensation, however, 
we must accept ripples in both the passband and the stopband. In addition, because 
of zeros in the numerator of H(s), the elliptic filter response decays at a slower rate 
at frequencies higher than ws. For instance, the amplitude response of a third- 
order elliptic filter decays at a rate of only —6 dB/octave at very high frequencies. 
This is because the filter has two zero and three poles. The two zeros increase 
the amplitude response at a rate of 12 dB/octave, and the three poles reduce the 
amplitude response at a rate of —18 dB/octave, thus giving a net decay rate of -6 
dB/octave. For the Butterworth and Chebyshev filters, there are no zeros in H{(s). 
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Therefore, their amplitude response decays at a rate of -18 dB/octave. However, 
the rate of decay of the amplitude response is seldom important as long as we meet 
our specification of a given G, at ws. 

Calculation of pole-zero locations of elliptic filters is much more complicated 
than that in Butterworth or even Chebyshev filters. Fortunately, this task is greatly 
simplified by computer programs and extensive ready-made design Tables available 
in the literature. The MATLAB function [z,p,k]=ellipap(n,-Gp,-Gs) in Signal Pro- 
cessing Toolbox determines poles, zeros, and the gain factor of a normalized analog 
elliptic lowpass filter of order n with a minimum passband gain Gp dB, and maxi- 
mum stopband gain Gs dB. The normalized passband edge is 1 rad/s. 


© Computer Example C7.10 


Design the lowpass elliptic filter for the specifications in Example 7.7 using functions 
from Signal Processing Toolbox in MATLAB. 


Wp=10;Ws=16.5;Gp=-2;Gs=-20; 
[n,Wp] =ellipord(Wp, Ws,-Gp,-Gs,’s’); 
[num,den]=ellip(n,-Gp,-Gs, Wp,’s’) 


MATLAB returns n = 3 and num= 0 2.7881 0 481.1626, den= 1 7.261 106.9991 
481.1626; that is, 


H(s) = 2.78818? + 481.1626 
~ 83 + 7.26182 + 106.9991s + 481.1626 


To plot amplitude response, we can use the last three functions from Example C7.5. ©) 


7.7 Frequency Transformations 


Earlier we saw how a lowpass filter transfer function of arbitrary specifications 
can be obtained from a normalized lowpass filter using frequency scaling. Using 
certain frequency transformations, we can obtain transfer functions of highpass, 
bandpass, and bandstop filters from a basic lowpass filter (the prototype filter) 
design. For example, a highpass filter transfer function can be obtained from the 
prototype lowpass filter transfer function by replacing s with wp/s. Similar transfor- 
mations allow us to design bandpass and bandstop filters from appropriate lowpass 
prototype filters. 

The prototype filter may be of any kind, such as Butterworth, Chebyshev, 
elliptic, and so on. We first design a suitable prototype lowpass filter Hp(s). In 
the next step, we replace s with a proper transformation T (s) to obtain the desired 
highpass, bandpass, or bandstop filter. 


7.7-1 Highpass Filters 


Figure 7.27a shows an amplitude response of a typical highpass filter. The 
appropriate lowpass prototype response required for the design of a highpass filter 
in Fig. 7.27a is depicted in Fig. 7.27b. We must first determine this prototype filter 
transfer function H,(s) with the passband 0 < w < 1 and the stopband w > wp/ws. 
The desired transfer function of the highpass filter to satisfy specifications in Fig. 
7.27a is then obtained by replacing s with T(s) in Hp(s), where 
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Fig. 7.27 Frequency transformation for highpass filters. 
w 
T(s) = = (7.55) 


E Example 7.8 
Design a Chebyshev highpass filter with the amplitude response specifications illus- 
trated in Fig. 7.28a with ws = 100, wp = 165, Gs = 0.1 (—20 dB), and Gp = 0.794 (—2 dB). 


Step 1: Determine the prototype lowpass filter 
The prototype lowpass filter has ®» = 1 and ©, = 165/100 = 1.65. This means the 
prototype filter in Fig. 7.27b has a passband 0 < w < 1 and a stopband w > 1.65, as 
shown in Fig. 7.28b. Also, Gp = 0.794 (—2 dB) and Gs = 0.1(—20dB). We already 
designed a Chebyshev filter with these specifications in Example 7.7. The transfer 
function of this filter is [Eq. (7.54)] 
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Fig. 7.28 Highpass Filter Design for Example 7.8. 
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0.3269 
a A e 
s3 + 0.737882 + 1.02228 + 0.3269 
The amplitude response of this prototype filter is depicted in Fig. 7.28b. 


Step 2: Substitute s with T(s) in Hp(s) 
The desired highpass filter transfer function H (s) is obtained from H»(s) by replacing 
s with T(s) = wp/s = 165/s. Therefore 


Hp(s) = 


0.3269 
H(s) = 165) 3 165) 2 165 
(22)" + 0.7378 (185)? + 1.0222(155) + 0.3269 
s? + 515.9482 + 61445.75s + 13742005 
The amplitude response |H (jw)| for this filter is illustrated in Fig. 7.28a. a 


© Computer Example 07.11 
Design the highpass filter for the specifications in Example 7.8 using functions from 


Signal Processing Toolbox in MATLAB. We shall give here MATLAB functions for all 
types of filters. 


Ws=100;W p=165;Gp=-2;Gs=-20; 

% Butterworth 

[n,Wn]=buttord(Wp, Ws,-Gp,-Gs,’s’) 
[num,den]=butter(n,Wn,’high’,’s’) 

% Chebyshev 
[n,Wn]=cheblord(Wp,Ws,-Gp,-Gs,’s’) 
{num,den]=cheby1(n,-Gp,Wn,’high’,’s’) 
% Inverse Chebyshev 
[n,Wn]=cheb2ord(Wp,Ws,-Gp,-Gs,’s’) 
[num,den]=cheby2(n,-Gs,Wn,’high’,’s’) 
4 Elliptic 
[n,Wn]=ellipord(Wp,Ws,-Gp,-Gs,’s’) 
[num,den]=ellip(n,-Gp,-Gs,Wn,’high’,’s’) 


To plot amplitude response, we can use the last three functions in Example C7.5. © 


7.7-2 Bandpass Filters 


Figure 7.292 shows an amplitude response of a typical bandpass filter. To 
design such a filter, we first find Hp(s), the transfer function of a prototype lowpass 
filter, to meet the specifications in Fig. 7.29b, where ws is given by the smaller of 


Wp, W po — Ws,” or Wen” ~ Wp “pe (7 56) 
Ws, (wp, = Wp, ) Wo (Wp, = Wp, ) 


Now, the desired transfer function of the bandpass filter to satisfy the specifi- 
cations in Fig. 7.29a is obtained from Hp(s) by replacing s with T(s), where 


2 
T(s) eo oe (7.57) 
(wp -= wp,)s 
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Fig. 7.29 Frequency transformation for bandpass filters. 


a Example 7.9 

Design a Chebyshev bandpass filter with the amplitude response specifications shown 
in Fig. 7.30a with wp, = 1000, wp, = 2000, ws, = 450, ws, = 4000, Gs = 0.1 (—20dB), 
and Gp = 0.891 (—1dB). Observe that for Chebyshev filter, Gp = —1 dB is equivalent to 
f= 1 dB. 

The solution is executed in two steps: in the first step, we determine the lowpass 
prototype filter transfer function Hp(s). In the second step, the desired bandpass filter 
transfer function is obtained from Hp(s) by substituting s with T(s), the lowpass to 
bandpass transformation in Eq. (7.57). 


Step 1: Find H,(s), the lowpass prototype filter transfer function. 
This is done in 3 substeps as follows: 


Step 1.1: Find ws for the prototype filter. 
The frequency w, is found [using Eq. (7.56)], to be the smaller of 


1 t 0dB 
laGe)| 
0.891 -1 dB 
0.7 
0.5 
0.3 
0.1 -20 dB 
O 1000 2000 4000 6000 8000 0 1 2 335 4 
o- u> 


Fig. 7.30 Chebyshev Bandpass Filter Design for Example 7.9. 
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1000)(2000) — (450)? 

pce n =399 and S002000- 1000) 
which is 3.5. 
Step 1.2: Determine n : 
We now need to design a prototype lowpass filter in Fig. 7.29b with Gp = —1 dB, 
Gs = —20 dB, wp = 1, and ws = 3.5, as illustrated in Fig. 7.30b. The Chebyshev 


filter order n required to meet these specifications is obtained from Eq. (7.49b) (or 
Eq. (7.49a) because, in this case, wp = 1), as 


(4000)? — (1000)(2000) =k 


1 
a cosh” 1(3.5) 
a result, which is rounded up to n = 2. 


Step 1.3: Determine the prototype filter transfer function Hp(s) 

We can obtain the transfer function of the second-order Chebyshev filter by computing 
its poles for n = 2 and # = 1 (e = 0.5088) using Eq. (7.51). However, since Table 
7.4 lists the denominator polynomial for f = 1 and n = 2, we need not perform the 
computations and may use the ready-made transfer function directly as 


0.9826 
s? + 1.09775 + 1.1025 


Here we used Eq. (7.53) to find the numerator Kn = wae = JARs = 0.9826. The 


amplitude response of this prototype filter is depicted in Fig. 7.30b. 


Hp(s) = (7.58) 


Step 2: Find the desired bandpass filter transfer function H(s) using the 
lowpass to bandpass transformation. 
Finally, the desired bandpass filter transfer function H(s) is obtained from Hp(s) by 
replacing s with T(s), where [see Eq. (7.57)] 


8? + 2(10)® 
1000s 


Replacing s with T(s) in the right-hand side of Eq. (7.58) yields the final bandpass 
transfer function 


T(s) = 


9.826(10)°s? 


A(s) = ay i007 78 + 5.1025(10)®s? + 2.195(10)9s + 4(10) 12 


The amplitude response |H (jw)| of this filter is shown in Fig. 7.30a. E 


We may use a similar procedure for the Butterworth filter. Compared to Cheby- 
shev design, Butterworth filter design involves two additional steps. First, we need 
to compute the cutoff frequency w, of the prototype filter. For a Chebyshev filter, 
the critical frequency happens to the frequency where the gain is G p- This frequency 
is w = 1 in the prototype filter. For Butterworth, on the other hand, the critical 
frequency is the half power (or 3 dB-cutoff) frequency we, which is not necessarily 
the frequency where the gain is Gp. To find the transfer function of the Butterworth 
prototype filter, it is essential to know we. Once we know we, the prototype filter 
transfer function is obtained by replacing s with s/w, in the normalized transfer 
function H(s). This step is also unnecessary in the Chebyshev filter design. We 
shall demonstrate the procedure for the Butterworth filter design by an example 
below. 


7.7 Frequency Transformations 529 


t 
IH, (jo)| 


lHGo)| 


0.7586 -2.4 dB 
0.7 
0.5 
0.3 
0.1 +20 dB 
0 104 0 1 2 3 4s 


o- 


Fig. 7.31 Butterworth Bandpass Filter Design for Example 7.10. 


| Example 7.10 

Design a Butterworth bandpass filter with the amplitude response specifications il- 
lustrated in Fig. 7.3la with wp, = 1000, wp, = 2000, ws, = 450, ws, = 4000, Gp = 
0.7586 (—2.4dB), and Gs = 0.1 (—20 dB). 

As in the previous example, the solution is executed in two steps: in the first step, 
we determine the lowpass prototype filter transfer function Hp(s). In the second step, the 
desired bandpass filter transfer function is obtained from Hp(s) by substituting s with 
T(s), the lowpass to bandpass transformation in Eq. (7.57). 


Step 1: Find H,(s), the lowpass prototype filter transfer function. 
This goal is accomplished in 5 substeps used in the design of the lowpass Butterworth 
filter (see Example 7.6): 
Step 1.1: Find ws for the prototype filter. 
For the prototype lowpass filter transfer function Hp(s) with the amplitude response 
shown in Fig. 7.31b, the frequency ws is found [using Eq. (7.56)} to be the smaller of 


a 2 
(1000)(2000) — (450)? 35) and 
450(2000 — 1000) 4000(2000 — 1000) 


which is 3.5, as depicted in Fig. 7.31b. 


(4000)? — (1000)(2000) nee 


Step 1.2: Determine n 

For a prototype lowpass filter in Fig. 7.29b, Gp = -2.4 dB, G, = ~20 dB, wp = 1, 
and w. = 3.5. Hence, according to Eq. (7.39), the Butterworth filter order n required 
to meet these specifications is 


1 10? -1 
z =1.95 
= iog 35 8 EA = | 2 


which is rounded up to n = 2. 
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Step 1.3: Determine we 
In this step (which is not necessary for the Chebyshev design), we determine the 3 
dB cutoff frequency we for the prototype filter. Use of Eq. (7.41) yields 


3.5 


We 


Step 1.4: Determine the normalized transfer function H(8) 
The normalized second-order lowpass Butterworth transfer function from Table 7.1 
is 

1 


s?+V2s+1 


This is the transfer function of a normalized filter (meaning that we = 1). 


H(s) = 


Step 1.5: Determine the prototype filter transfer function H,(s) 
The prototype filter transfer function Hp(s) is obtained by substituting s with s/we = 
s/1.10958 in the normalized transfer function H(s) found in step 1.4 as 


(1.10958)? 1.231 
= = = ee 7.59 
ae) s? + s/2(1.10958)s + (1.10958)? s? + 1.5692s + 1.2312 (T59) 


The amplitude response of this prototype filter is illustrated in Fig. 7.31b. 


Step 2: Find the desired bandpass filter transfer function H (s) using the 
lowpass to bandpass transformation. 


Finally the desired bandpass filter transfer function H(s) is obtained from Hp(s) by 
replacing s with T(s), where [see Eq. (7.57)] 


2 6 
_ $° +2(10) 
T(s) = — 000s 
Replacing s with T (s) in the right-hand side of Eq. (7.59) yields the final bandpass 
transfer function 


1.2312(10)° s? 


H(s) = 77756055 + §.2312(10)® s2 + 3.1384(10)9s + 4(10)!2 


The amplitude response |H(jw)| of this filter is shown in Fig. 7.31a. E 


© Computer Example C7.12 

Design a bandpass filter for the specifications in Example 7.10 using functions from 
Signal Processing Toolbox in MATLAB. We shall give here MATLAB functions for the 
four types of filters. 

For bandpass filters, we use the same functions as those used for lowpass filter in 
Examples C7.6, C7.8-C7.10, with one difference: Wp and Ws are 2 element vectors as 
Wp=[Wpl Wp2], Ws=[Wsl Ws2}. 


Wp=[1000 2000];Ws=[450 4000];Gp=-2.4;Gs=-20; 
% Butterworth 

[n, Wn]=buttord(Wp, Ws,-Gp,-Gs,’s’) 

{num ,den]=butter(n,Wn,’s’) 

% Chebyshev 

{n, Wn]=cheblord(Wp,Ws,-Gp,-Gs,’s’); 
[num,den]=cheby1(N,-Gp,Wn,’s’) 
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% Inverse Chebyshev 
[n,Ws]=cheb2ord(Wp, Ws,-Gp,-Gs,’s’); 
{num,den]=cheby2(n,-Gs,Ws,’s’) 

4 Elliptic filter 

[n, Wn]=ellipord(Wp, Ws,-Gp,-Gs,’s’); 
{num,den]=ellip(n,-Gp,-Gs,Wn,’s’) © 


To plot amplitude response, we can use the last three functions from Example 
C7.5. 


7.7-3 Bandstop Filters 


Figure 7.32a shows an amplitude response of a typical bandstop filter. To 
design such a filter, we first find H,(s), the transfer function of a prototype lowpass 
filter, to meet the specifications in Fig. 7.32b, where ws is given by the smaller of 


(Wp, Z Wp Jus, oF (wp 7 Wp, wsz 


ETA) 2 
Wp Wp, — Ws, Wea" — Wp Wp. 


(7.60) 


The desired transfer function of the bandstop filter to satisfy the specifications 
in Fig. 7.32a is obtained from Hp(s) by replacing s with T(s), where 


(wp, — Wp, )s 
T(s)= an ps) 
8° + Wp Wp, 


(7.61) 
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Fig. 7.32 Frequency transformation for bandstop filters. 


@ Example 7.11 

Design a Butterworth bandstop filter with the specifications depicted in Fig. 7.33a 
with wp, = 60, wp, = 260, ws, = 100, ws, = 150, Gp = 0.776 (—2.2dB), and G; = 
0.1(-20dB). 

In the first step we shall determine the prototype lowpass filter transfer function 
Hp(s), and in the second step we use the lowpass to bandstop transformation in Eq. (7.61) 
to obtain the desired bandstop filter transfer function H (s). 


Step 1: Find H,(s), the lowpass prototype filter transfer function. 


This goal is accomplished in 5 substeps used in the design of the lowpass Butterworth 
filter (see Example 7.6): 
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Fig. 7.33 Butterworth Bandstop Filter Design for Example 7.11. 


Step 1.1: Find w, for the prototype filter. 

For the prototype lowpass filter transfer function Hp(s) with the specifications illus- 
trated in Fig. 7.32b, the frequency ws is found (using Eq. (7.60)] to be the smaller 
of 


(100)(260 — 60) 
(260)(60) — 1002 
which is 3.57, as shown in Fig. 7.33b. 
Step 1.2: Determine n . . 
For the prototype lowpass filter in Fig. 7.33b, Gp = —2.2 dB, G, = —20 dB, Wp =1, 


and ws = 3.57. According to Eq. (7.39), the Butterworth filter order n required to 
meet these specifications is 


150(260 — 60) 


= 3.57 and 1502 — (260)(60) 


= 4.347 


1 | 10? -1 


= —— m | | =1.968 
"= 2 log(3.57) ma] nee 


We round up the value of n to 2. 


Step 1.3: Determine we 
The half power frequency we for the prototype Butterworth filter, using Eq. (7.40) 
with wp = 1, is 


Wp 1 


= —— 2 = = 1.1096 
(107ĉ»/10 —1)4 (100-22 — 1)ł 


We 


Step 1.4: Determine the normalized transfer function 
The transfer function of the second-order normalized Butterworth filter from the 
Table 7.1 is i 


Hise 
(s) s?4V2s+1 


(7.62) 
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Step 1.5: Determine the prototype filter transfer function Hp(s) 
The prototype filter transfer function Hp(s) is obtained by substituting s with s/w. = 
s/1.1096 in the normalized transfer function H(s) in step 1.4. This move yields 


1 1.2312 


(2) = (£) + VIL +1 P+ 156925 + 1.2312 


(7.63) 


The amplitude response of this prototype filter is depicted in Fig. 7.33b. 


Step 2: Find the desired bandstop filter transfer function H(s) using the 
lowpass to bandstop transformation 
Finally, the desired transfer function H(s) of the bandpass filter with specifications 
illustrated in Fig. 7.33a is obtained from Hp(s) by replacing s with T(s), where {see 
Eq. (7.61)] 


200s 
s? + 15, 600 


Replacing s with T(s) in the right-hand side of Eq. (7.63) yields the final bandstop 
transfer function 


T(s) = 


1.2312 
(tss)? + 1.5692 20) + 1.2312 


N (s? + 15600)? 
-84 + 254.983 + 63690.9s? + (3.977)106s + (2.433)10° 


H(s) = 


The amplitude response |H (jw)| is shown in Fig. 7.33a. [i 


© Computer Example C7.13 

Design the bandstop filter for the specifications in Example 7.11 using functions from 
Signal Processing Toolbox in MATLAB. We shall give here MATLAB functions for all the 
four types of filters. 


Wp=([60 260]; Ws=[100 150]; Gp=-2.2;Gs=-20; 
% Butterworth 

[n,Wn]=buttord(Wp, Ws,-Gp,-Gs,’s’) 
[num,den]=butter(n,Wn,’stop’,’s’) 

% Chebyshev 

[n, Wn]=cheblord(Wp, Ws,-Gp,-Gs,’s’) 
[num,den]=cheby1(n,-Gp,Wn,’stop’,’s’) 

% Inverse Chebyshev 

{n,Wn]=cheb2ord(Wp, Ws,-Gp,-Gs,’s’) 
{num,den}=cheby2(n,-Gs,Wn,’stop’,’s’) 

⁄ Elliptic 

[n, Wn]}=ellipord(Wp, Ws,-Gp,-Gs,’s’) 
{num,den]=ellip(n,-Gp,-Gs, Wn,’stop’,’s’) © 


7.8 Filters to Satisfy Distortionless transmission Conditions 


The purpose of a filter is to suppress unwanted frequency components and 


to transmit the desired frequency components without distortion. In Sec. 4.4, we 
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saw that this requires the filter amplitude response to be constant and the phase 
response to be a linear function of w over the passband. 

The filters discussed so far have stressed the constancy of the amplitude re- 
sponse. The linearity of the phase response has been ignored. As we saw earlier, 
the human ear is sensitive to amplitude distortion but somewhat insensitive to 
phase distortion. For this reason filters in audio application are designed primar- 
ily for constant amplitude response, and the phase response is only a secondary 
consideration. 

We also saw earlier that the human eye is sensitive to phase distortion and 
relatively insensitive to amplitude distortion. Therefore, in video applications we 
cannot ignore phase distortion. In pulse communication, both the amplitude and 
the phase distortion are important for correct information transmission. Thus, 
in practice, we also need to design filters primarily for phase linearity in video 
applications. In pulse communication applications, it is important to have filters 
with constant amplitude response and a linear phase response. We shall briefly 
discuss some aspects and approaches to the design of such filters. More discussion 
appears in the literature.” 

We showed {see Eq. (4.59)| that the time delay ta resulting from the signal 
transmission through a filter is the negative of the slope of the filter phase response 
ZH (jw); that is, 


talw) = --Ž LH (ju) (7.64) 


If the slope of ZH (jw) is constant over the desired band (that is, if ZH (jw) is linear 
with w), all the components are delayed by the same time interval tg. In this case 
the output is a replica of the input, assuming that all components are attenuated 
equally; that is, |H (jw)| = constant over the passband. 

If the slope of the phase response is not constant, tg, the time delay, varies 
with frequency. This variation means that different frequency components undergo 
different amounts of time delay, and consequently the output waveform will not 
be a replica of the input waveform even if the amplitude response is constant over 
the passband. A good way of judging phase linearity is to plot tg as a function of 
frequency. For a distortionless system, ta (the negative slope of ZH (jw)) should 
be constant over the band of interest. This is in addition to the requirement of 
constancy of the amplitude response. 

Generally speaking, the two requirements of distortionless transmission conflict. 
The more we approach the ideal amplitude response, the further we deviate from the 
ideal phase response. The sharper the cutoff characteristic (smaller the transition 
band), the more nonlinear is the phase response near the transition band. We 
can verify this fact from Fig. 7.34, which shows the delay characteristic of the 
Butterworth and the Chebyshev family of filters. The Chebyshev filter, which has a 
sharper cutoff than that of the Butterworth, shows considerably more variation in 
time delay of various frequency components as compared to that of the Butterworth. 

For the applications where the phase linearity is also important, there are two 
possible approaches: 


1 Iftg = constant (phase linearity) is the primary requirement, we design a filter 
for which tg is maximally flat around w = 0 and accept the resulting ampli- 
tude response, which may not be so flat nor have a sharp cutoff characteristic. 
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Fig. 7.34 Delay characteristics of the Butterworth and Chebyshev filters. 


Contrast this with the Butterworth filter, which is designed to yield the max- 
imally flat amplitude response at w = 0 without any attention to the phase 
response. A family of filters which yields a maximally flat tg goes under the 
name Bessel-Thomson filters, which uses the nth-order Bessel polynomial 
in the denominator of nth-order H (s). 

2 If both amplitude and phase response are important, we start with a filter to 
satisfy the amplitude response specifications, disregarding the phase response 
specifications. We cascade this filter with another filter, an equalizer, whose 
amplitude response is flat for all frequencies (the allpass filter) and whose 
ta characteristic is complementary to that of the main filter in such a way that 
their composite phase characteristic is approximately linear. The cascade thus 
has linear phase and the amplitude response of the main filter (as required). 


Allpass Filters 


An allpass filter has equal number of poles and zeros. All the poles are in the 
LHP (left half plane) for stability. All the zeros are mirror images of the poles about 
the imaginary axis. In other words, for every pole at —a + jb, there is a zero at 
a + jb. Thus, all the zeros are in the RHP. Any filter with this kind of pole-zero 
configuration is an allpass filter; that is, its amplitude response is constant for all 
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frequencies. We can verify this assertion by considering a transfer function with a 
pole at —a + jb and a zero at a+ jb: 


nets ae Gp) See a eee) 
s+a-— jb jw +a-— jb a+j(w—b) 
Therefore 
: V(—a)? + (w — bF} 
H(jw)| = =1 7.65 
|E (jw)| Ae aT ( ) 
CH (jw) = tan™' j=) -— tan”! [2 = " 
a 


= 7 — tan”! few — tan} [2 = e] =r —2tan7} [=] (7.66) 
a a a 


Observe that although the amplitude response is unity regardless of pole-zero 
locations, the phase response depends on the locations of poles (or zeros). By 
placing poles in proper locations, we can obtain a desirable phase response that is 
complementary to the phase response of the main filter. 


7.9 Summary 


The response of an LTIC system with transfer function H (s) to an everlasting 
sinusoid of frequency w is also an everlasting sinusoid of the same frequency. The 
output amplitude is |H (jw)| times the input amplitude, and the output sinusoid is 
shifted in phase with respect to the input sinusoid by ZH (jw) radians. The plot of 
|H (jw)| vs w indicates the amplitude gain of sinusoids of various frequencies and 
is called the amplitude response of the system. The plot of ZH (jw) vs w indicates 
the phase shift of sinusoids of various frequencies and is called the phase response. 

Plotting of the frequency response is remarkably simplified by using logarithmic 
units for amplitude as well as frequency. Such plots are known as the Bode plots. 
The use of logarithmic units makes it possible to add (rather than multiply) the 
amplitude response of four basic types of factors that occur in transfer functions: 
(1) a constant (2) a pole or a zero at the origin (3) a first order pole or a zero, 
and (4) complex conjugate poles or zeros. For phase plots, we use linear units for 
phase and logarithmic units for the frequency. The phases corresponding to the 
three basic types of factors mentioned above add. The asymptotic properties of the 
amplitude and phase responses allow their plotting with remarkable ease even for 
transfer functions of high orders. 

The frequency response of a system is determined by the locations in the com- 
plex plane of poles and zeros of its transfer function. We can design frequency 
selective filters by proper placement of its transfer function poles and zeros. Plac- 
ing a pole (a zero) near a frequency jwo in the complex plane enhances (suppresses) 
the frequency response at the frequency w = wo. With this concept, a proper combi- 
nation of poles and zeros at suitable locations can yield desired filter characteristics. 

Two families of analog filters are considered: Butterworth and Chebyshev. 
The Butterworth filter has a maximally flat amplitude response over the passband. 
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The Chebyshev amplitude response has ripples in the passband. On the other 
hand, the behavior of the Chebyshev filter in the stopband is superior to that of 
the Butterworth filter. The design procedure for lowpass filters can be readily 
applied to highpass, bandpass, and bandstop filters by using appropriate frequency 
transformations discussed in Sec. 7.7. 

Allpass filters have a constant gain but a variable phase with respect to fre- 
quency. Therefore, placing an allpass filter in cascade with a system leaves its 
amplitude response unchanged, but alters its phase response. Thus, an allpass filter 
can be used to modify the phase response of a system. 
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Problems 


7.1-1 For an LTIC system described by the transfer function 


s+2 


WS) =a esa pa 


find the response to the following everlasting sinusoidal inputs: (a) 5cos(2t + 
30°) (b) 10sin (2t + 45°) (c) 10cos(3¢ + 40°). Observe that these are everlasting 
sinusoids. 


7.1-2 For an LTIC system described by the transfer function 


find the steady-state system response to the following inputs: 
(a) 10u(t) (b) cos (2t+60°)u(t) (c) sin(3t—45°)u(t) (d) e7**u(t) 


7.1-3 For an allpass filter specified by the transfer function 


find the system response to the following (everlasting) inputs: (a) e7”* (b) cos (wt+6) 
(c) cost (d) sin 2t (e) cos 10¢ (f) cos 100t. 


Comment on the filter response. 


7.2-1 Sketch Bode plots for the following transfer functions: 


s(s + 100) (s + 10)(s + 20) (s + 10)({s + 200) 


a Faero ©) aeto O TF 20)2(s + 1000) 
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f(t) Ep 
aac 


f(t) y(t) 


f(t) y(t) 
e 


Fig. P7.3-1 


7.2-2 Repeat Prob. 7.2-1 if 


s? b) s (c) (s + 10) 
(a) (s + 1)(s? + 4s + 16) ( (s + 1)(s? + 14.14s + 100) s(s? + 14.14s + 100) 


7.3-1 Feedback can be used to increase (or decrease) the system bandwidth. Consider a 
system in Fig. P7.3-1a with transfer function G(s) = 5#5>- 
(a) Show that the 3 dB bandwidth of this system is we. 
(b) To increase the bandwidth of this system, we use negative feedback with H (s) =9, 
as depicted in Fig. P7.3-1b. Show that the 3 dB bandwidth of this system is 10w-. 
(c) To decrease the bandwidth of this system, we use positive feedback with H (s) = 
—0.9, as illustrated in Fig. P7.3-1c. Show that the 3 dB bandwidth of this system is 
we/10. 
The system gain at dc times its 3 dB bandwidth is called the gain-bandwidth 
product of a system. Show that this product is the same for all the three systems in 
Fig. P7.3-1. This result shows that if we increase the bandwidth, the gain decreases 


and vice versa. 


7.4-1 Using the graphical method of Sec 7.4-1, draw a rough sketch of the amplitude and 
phase response of an LTIC system described by the transfer function 


s? —2s+50  (s—1-J7)(3-1+397) 


H(s)= 3795450 ~ (@+1—37s +1407) 


What kind of filter is this? 


s plane 


(a) (b) 
Fig. P7.4-2 
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7.4-2 


7.4-3 


7.5-1 


7.5-2 


7.5-3 


7.6-1 
7.6-2 


7.6-3 


7.6-4 


7.7-1 


7.7-2 


7.7-3 


T.T-4 


7.7-5 


Using the graphical method of Sec. 7.4-1, draw a rough sketch of the amplitude and 
phase response of LTIC systems whose pole-zero plots are shown in Fig. P7.4-2. 


Design a second-order bandpass filter with center frequency w = 10. The gain should 
be zero at w = 0 and at w = oo. Select poles at —a + j10. Leave your answer in 
terms of a. Explain the influence of a on the frequency response. 


Determine the transfer function H (s) and the amplitude response H (jw) for a third- 
order lowpass Butterworth filter if the 3 dB cutoff frequency we = 100. Find your 
answer without using Tables 7.1 or 7.2. Verify your answer using either of these 
Tables. 


Determine n, the order of a lowpass Butterworth filter, and the corresponding cutoff 
frequency we required to satisfy the following lowpass filter specifications. Find both 
the values of wc, the one that oversatisfies the passband specifications, and the one 
that oversatisfies the stopband specifications. 


(a) Gp > —0.5 dB, G, < —20 dB, wp = 100 rad/s, and ws = 200 rad/s. 

(b) Gp > 0.9885, Gs < 1077, wp = 1000 rad/s, and ws = 2000 rad/s. 

(c) The gain at 3we is required to be no greater than —50 dB. 

Find the transfer function H(s) and the amplitude response H(jw) for a lowpass 
Butterworth filter to satisfy the specifications: Gp > —3 dB, G. < -14 dB, Wp = 
100, 000 rad/s, and ws = 150, 000 rad/s. It is desirable to oversatisfy (if possible) the 
requirement of Gs. Determine the Gp and G, of your design. 


Repeat Prob. 7.5-1 for a Chebyshev filter. Do not use Tables. 


Design a lowpass Chebyshev filter to satisfy the specifications: Gp > -1 dB, Gs < 
—22 dB, wp = 100 rad/s, and ws = 200 rad/s. 
Design a lowpass Chebyshev filter to satisfy the specifications: Gp > -2 dB, G. < 


—25 dB, wp = 10 rad/s, and ws = 15 rad/s. 


Design a lowpass Chebyshev filter whose 3 dB cutoff frequency is wc, and the gain 
drops to —50 dB at 3we. 


Find the transfer function H (s) for a highpass Butterworth filter to satisfy the spec- 
ifications: Gs < —20 dB, Gp > —1 dB, ws = 10, and wp = 20. 


Find the transfer function H (s) for a highpass Chebyshev filter to satisfy the speci- 
fications: Gs < —22 dB, Gp > —1 dB, ws = 10, and wp = 20 


Find the transfer function H (s) for a Butterworth bandpass filter to satisfy the spec- 
ifications: Gs < —17 dB, Gp > —3 dB, wp, = 100 rad/s, wp, = 250 rad/s, and 
ws, = 40 rad/s, ws. = 500 rad/s. 


Find the transfer function H (s) for a Chebyshev bandpass filter to satisfy the speci- 
fications: Gs < —17 dB, # < 1 dB, wp, = 100 rad/s, wp, = 250 rad/s, and ws, = 40 
rad/s, ws, = 500 rad/s. 


Find the transfer function H (s) for a Butterworth bandstop filter to satisfy the speci- 
fications: G. < —24 dB, Gp > —3 dB, wp, = 20 rad/s, wp, = 60 rad/s, and ws, = 30 
rad/s, ws, = 38 rad/s. 


Discrete-Time | 
Signals and Systems 


In this chapter we introduce the basic concepts of discrete-time signals and 
systems. 


8.1 Introduction 


Signals specified over a continuous range of t are continuous-time signals, 
denoted by the symbols f(t), y(t), etc. Systems whose inputs and outputs are 
continuous-time signals are continuous-time systems. In contrast, signals defined 
only at discrete instants of time are discrete-time signals. Systems whose inputs 
and outputs are discrete-time signals are called discrete-time systems. A digital 
computer is a familiar example of this type of system. We consider here uniformly 
spaced discrete instants such as ..., —2T, —T, 0, T, 2T, 3T, ..., kT, .... Discrete- 
time signals can therefore be specified as f(kT), y(kT), and so on (k, integer). 
We further simplify this notation to f{k],y[k], etc., where it is understood that 
f[k] = f(kT) and that k is an integer. A typical discrete-time signal, depicted in 
Fig. 8.1, is therefore a sequence of numbers. This signal may be denoted by f (kT) 
and viewed as a function of time t where signal values are specified at t = kT. 
It may also be denoted by f[k] and viewed as a function of k (k, integer). For 
instance, a continuous-time exponential f(t) = e~*, when sampled every T = 0.1 
second, results in a discrete-time signal f(kT) given by 


f (kT) = e kT = e70 1k 


Clearly, this signal is a function of k and may be expressed as f [k]. We can plot this 
signal as a function of t or as a function of k (k, integer). The representation f [k} is 
more convenient and will be followed throughout this book. A discrete-time signal 
therefore may be viewed as a sequence of numbers, and a discrete-time system may 
be seen as processing a sequence of numbers f[k] and yielding as output another 
sequence of numbers y[k]. 


540 
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FEKI} or ART) 


K [ltir 


5 k— 


{p = 


-27 T 5T 107 


Fig. 8.1 A discrete-time signal. 


Discrete-time signals arise naturally in situations which are inherently discrete- 
time, such as population studies, amortization problems, national income models, 
and radar tracking. They may also arise as a result of sampling continuous-time 
signals in sampled data systems, digital filtering, and so on. Digital filtering is a 
particularly interesting application in which continuous-time signals are processed 
by discrete-time systems, using appropriate interfaces at the input and output, as 
illustrated in Fig. 8.2. A continuous-time signal f(t) is first sampled to convert it 
into a discrete-time signal ffk], which is then processed by a discrete-time system 
to yield the output y[k]. A continuous-time signal y(t) is finally constructed from 
y[k]. We shall use the notations C/D and D/C for continuous-to-discrete-time and 
discrete-to-continuous-time conversion. Using the interfaces in this manner, we can 
process a continuous-time signal with an appropriate discrete-time system. As we 
shall see later in our discussion, discrete-time systems have several advantages over 
continuous-time systems. For this reason, there is an accelerating trend toward 
processing continuous-time signals with discrete-time systems. 


Discrete to 
Continuous 
D/C 


Discrete-time 


y) 
system 


Discrete 
C/D 


Fig. 8.2 Processing a continuous-time signal by a discrete-time system. 


8.2 Some Useful Discrete-Time Signal Models 


We now discuss some important discrete-time signal models which are encoun- 
tered frequently in the study of discrete-time signals and systems. 
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8 [k] 


| ea 


(b) 


m k— 


Fig. 8.3 Discrete-time impulse function. 


1. Discrete-Time Impulse Function 6[x] 


The discrete-time counterpart of the continuous-time impulse function 6(t) is 


6[k], defined by 
1 k=0 
6[k] = (8.1) 
[k] k k #0 
This function, also called the unit impulse sequence, is shown in Fig. 8.3a. The time- 
shifted impulse sequence [k —m] is depicted in Fig. 8.3b. Unlike its continuous-time 
counterpart 6(t), this is a very simple function without any mystery. 
Later, we shall express an arbitrary input j [k] in terms of impulse components. 
The (zero-state) system response to input f[k] can then be obtained as the sum of 
system responses to impulse components of f [k]. 


2. Discrete-Time Unit Step Function u[k] 
The discrete-time counterpart of the unit step function u(t) is u[k] (Fig. 8.4), 
defined by 
1 fork >0 
= ~ 8.2 
ull P for k < 0 ee 


If we want a signal to start at k = 0 (so that it has a zero value for all k < 0), 
we need only multiply the signal with u[k]. 


u [k] 


Fig. 8.4 A discrete-time unit step function ufk]. 
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2 LHP j F : i x : Exponential} 
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= A 
a Exponentially 
E decreasing 
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È 

A-plane 


(a) (b) 
Fig. 8.5 The \-plane, the y-plane and their mapping. 


3. Discrete-Time Exponential y* 


A continuous-time exponential e*t can be expressed in an alternate form as 
ew =y (y =e* or à =ln7) (8.3a) 


For example, e~°** = (0.7408)! because e~°3 = 0.7408. Conversely, 4¢ = e1-386t 
because ln 4 = 1.386, that is, e1386 = 4. In the study of continuous-time signals 
and systems we prefer the form e% rather than 7t. The discrete-time exponential 
can also be expressed in two forms as 


e* k à 


=y (y=e^ or \=ln7) (8.3b) 
For example, e** = (e3)* = (20.086)*. Similarly, 5* = e1609k because 5 = e1609, 
In the study of discrete-time signals and systems, unlike the continuous-time case, 
the form y* proves more convenient than the form e**. Because of unfamiliarity 
with exponentials with bases other than e, exponentials of the form y* may seem 
inconvenient and confusing at first. The reader is urged to plot some exponentials 
to acquire a sense of these functions. 


Nature of y*: The signal eò grows exponentially with k if Re À > 0 (à in 
RHP), and decays exponentially if Re A < 0 (A in LHP). It is constant or oscillates 
with constant amplitude if Re A = 0 (A on the imaginary axis). Clearly, the location 
of À in the complex plane indicates whether the signal e** grows exponentially, 
decays exponentially, or oscillates with constant frequency (Fig. 8.5a). A constant 
signal (À = 0) is also an oscillation with zero frequency. We now find a similar 
criterion for determining the nature of y* from the location of y in the complex 
plane. 

Figure 8.5a shows a complex plane (\-plane). Consider a signal e4®*. In this 
case, A = jQ lies on the imaginary axis (Fig. 8.5a), and therefore is a constant- 
amplitude oscillating signal. This signal e7°* can be expressed as y*, where y = ef? 
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Because the magnitude of e° is unity, |y| = 1. Hence, when A lies on the imaginary 
axis, the corresponding y lies on a circle of unit radius, centered at the origin (the 
unit circle illustrated in Fig. 8.5b). Therefore, a signal y* oscillates with constant 
amplitude if y lies on the unit circle. Remember, also, that a constant signal 
(A = 0, y = 1) is an oscillating signal with zero frequency. Thus, the imaginary axis 
in the A-plane maps into the unit circle in the y-plane. 

Next consider the signal e**, where A lies in the left-half plane in Fig. 8.5a. 
This means A = a + jb, where a is negative (a < 0). In this case, the signal decays 
exponentially. This signal can be expressed as ~*, where 


Ja eò = ett — 9% oid 


and 


ly} = jef] je] =e* because je?| = 1 

Also, a is negative (a < 0). Hence, |y| = e? < 1. This result means that the cor- 
responding y lies inside the unit circle. Therefore, a signal y* decays exponentially 
if y lies within the unit circle (Fig. 8.5b). If, in the above case we had selected a 
to be positive, (à in the right-half plane), then |y| > 1, and y lies outside the unit 
circle. Therefore, a signal y? grows exponentially if y lies outside the unit circle 
(Fig. 8.5b). 

To summarize, the imaginary axis in the \-plane maps into the unit circle in the 
y-plane. The left-half plane in the \-plane maps into the inside of the unit circle and 
the right-half of the \-plane maps into the outside of the unit circle in the y-plane, 
as depicted in Fig. 8.5. This fact means that the signal y? grows exponentially with 
k if y is outside the unit circle (|y| > 1), and decays exponentially if y is inside the 
unit circle (|y| < 1). The signal is constant or oscillates with constant amplitude if 


y is on the unit circle (|y| = 1). 
k 
1 
WF = (=) (8.4) 
x 


Observe that 

Figures 8.6a and 8.6b show plots of (0.8)*, and (—0.8)*, respectively. Figures 
8.6c and 8.6d show plots of (0.5)*, and (1.1)*, respectively. These plots verify our 
earlier conclusions about the location of y and the nature of signal growth. Observe 
that a signal (—7)* alternates sign successively (is positive for even values of k and 
negative for odd values of k, as depicted in Fig. 8.6b). Also, the exponential (0.5)* 
decays faster than (0.8)*. The exponential (0.5)* can also be expressed as 2~* 
because (0.5)~! = 2 [see Eq. (8.4)]. 


A Exercise E8.1 

Sketch signals (a) (1)* (b) (-1)* (c) (0.5)* (d) (—0.5)* (e)(0.5)—* (f) 2-* (g) (-2)*. 
Express these exponentials as y”, and plot y in the complex plane for each case. ‘Verify that + 
decays exponentially with k if y lies inside the unit circle, and that yë grows with k if y is outside 
the unit circle. If y is on the unit circle, y* is constant or oscillates with a constant amplitude. 
Hint: (1)* = 1 for all k. However, (—1)* = 1 for even values of k and is —1 for odd values of 
k. Therefore, (—1)* switches back and forth from 1 to —1 (oscillates with a constant amplitude). 


Note also that Eq. (8.4) yields (0.5)-* =2* y 
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Fig. 8.6 discrete-time exponentials y*. 


A Exercise E8.2 
(a) Show that (i) (0.25)-* = 4k (ii 


(0.1383) = Cr 360) A) OR ini er (0.25)* (iii) e?t = (7.389)¢ (iv) e~t = 


= (0.2231)* = (4.4817)~* 


(b) Show that (i) 2% = ¢0.693k (ii) (0.5)* = e70-693k (iii) (0.8)—* = ¢9-2231k 


V 
© Computer Example C8.1 


Sketch the discrete-time signals (a) (—0.5)* (b) (2)-* (c) (—2)* 
(a) k=0:5; k=k’; fk1=(-0.5).*k; 
; ; -5).°k; stem(k,fk) 
(b) k=0:5; k=k’; fk=2.*(-k); stem(k,fk) 
(c) k=0:5; k=k’;fk= (-2).*k; stem(k,fk3) © 


4. Discrete-Time Exponential 23% 


A general discrete-time exponential e7* (also called phasor) 
valued function of k and therefore its graphical description requires t 
part and imaginary part or magnitude and angle) i 
ae the values of e/@k in the complex plane for various values of k, as illustrated 
in Fig. 8.7. The function f [k] = e3@* takes on values 29, ei, ejN e382 at 


k = 0,1,2,3 res i i 
> 5 “9 9, +++, respectively. For the sake of simplicit i 
negative values of k for the time being. Note that Se i 


is a complex 
wo plots (real 
- To avoid two plots, we shall 
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. at 
Locus of e/* Locus of e~ 


k=3 


Fig. 8.7 Locus of (a) e°% (b) e~9*, 


Ik = rer? r=1, and @=k2 

This fact shows that the magnitude and angle of e°% are 1 and kQ, respectively. 
Therefore, the points e°, eJ%, 6/2, ¢/89, ., eJk2, |. lie on a circle of unit ra- 
dius (unit circle) at angles 0, Q, 20, 30,..., kQ, ... respectively, as shown in Fig. 
8.7a. For each unit increase in k, the function f[k] = e/@* moves along the 
unit circle counterclockwise by an angle 2. Therefore, the locus of e4®* may be 
viewed as a phasor rotating counterclockwise at a uniform speed of Q radians per 
unit sample interval. The exponential e~#%*, on the other hand, takes on values 
eJ? = 1, e7I9, e7i2Nk e739., at k = 0, 1, 2, 3, ..., as depicted in Fig. 8.7b. 
Therefore, e~3%* may be viewed as a phasor rotating clockwise at a uniform speed 
of Q radians per unit sample interval. 

Using Euler’s formula, we can express an exponential 
of the form cos (Qk + @), and vice versa 


ef = (cos Nk + j sin Nk) (8.5a) 
e738 = (cos Nk — j sin Nk) (8.5b) 


These equations show that the frequency of both ef?F and e-3** is Q (ra- 
dians/sample). Therefore, the frequency of e7°* is |Q|. Because of Eqs. (8.5), 
exponentials and sinusoids have similar properties and peculiarities. The discrete- 
time sinusoids will be considered next. 


e3@k in terms of sinusoids 


5. Discrete-Time Sinusoid cos (Qk + 8) 

A general discrete-time sinusoid can be expressed as C cos (Qk + 8), where C 
is the amplitude, Q is the frequency (in radians per sample), and @ is the phase (in 
radians). Figure 8.8 shows a discrete-time sinusoid cos (75k + 3). 

Here we make one basic observation. Because cos(—z) = cos (zx), 

cos (—Qk + 0) = cos (Qk — 6) (8.6) 


This shows that both cos (Qk + 6) and cos (—Qk + 6) have the same frequency (N). 
Therefore, the frequency of cos (Qk + 8) is |Q]. 
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l cos (BAe 


33 -21 -9 0 3 is 27 


Fig. 8.8 A discrete-time sinusoid cos( {5k + 5). 


© Computer Example C8.2 
Sketch the discrete-time sinusoid cos (Sk + z) 
k=-36:30; k=k’; 
fk=cos(k*pi/12+pi/4); 
stem(k,fk) © 


Sampled Continuous-Time Sinusoid Yields a Discrete-Time Sinusoid 


A continuous-time sinusoid cos wt sampled every T seconds yields a discrete- 
time sequence whose kth element (at t = kT) is cos wkT. Thus, the sampled signal 
fk] is given by 

f [k] = cos wkT 
= cos Nk where Q = wT (8.7) 


Clearly, a continuous-time sinusoid cos wt sampled every T seconds yields a discrete- 
time sinusoid cos Qk, where 2 = wT. Superficially, it may appear that a discrete- 
time sinusoid is a continuous-time sinusoid’s cousin in a striped suit. As we shall 
see, however, some of the properties of discrete-time sinusoids are very different 
from those of continuous-time sinusoids. In the continuous-time case, the period 
of a sinusoid can take on any value; integral, fractional, or even irrational. The 
discrete-time signal, in contrast, is specified only at integral values of k. Therefore, 
the period must be an integer (in terms of k) or an integral multiple of T (in terms 
of variable t). 


Some Peculiarities of Discrete-Time Sinusoids 


There are two unexpected properties of discrete-time sinusoids which distin- 
guish them from their continuous-time relatives. 

1. A continuous-time sinusoid is always periodic regardless of the value of its 
frequency w. But a discrete-time sinusoid cos Nk is periodic only if Q is 2r 
times some rational number ( 2 is a rational number). 

2. A continuous-time sinusoid cos wt has a unique waveform for each value of w. 
In contrast, a sinusoid cos Nk does not have a unique waveform for each value 
of Q. In fact, discrete-time sinusoids with frequencies separated by multiples of 
2r are identical. Thus, a sinusoid cos Qk = cos (Q+2r)k = cos (N+4r)k =- -~ 
We now examine each of these peculiarities. 


1 Not All Discrete-Time Sinusoids Are Periodic 
A discrete-time signal f{k] is said to be No-periodic if 


f{k] = f{k + No] (8.8) 
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for some positive integer No. The smallest value of No that satisfies Eq. (8.8) is 
the period of f[k]. Figure 8.9 shows an example of a periodic signal of period 6. 
Observe that each period contains 6 samples (or values). If we consider the first 
cycle to start at k = 0, the last sample (or value) in this cycle is at k = No- 1 =5 
(not at k = No = 6). Note also that, by definition, a periodic signal must begin at 
k = —oo (everlasting signal) for the reasons discussed in Sec. 1.2-4. 


SK) 


Fig. 8.9 Discrete-time periodic signal. 


If a signal cos Qk is No-periodic, then 


cos Nk = cos N(k + No) 
= cos (Qk + No) 


This result is possible only if QNo is an integral multiple of 27; that is, 


QNo = 2nm m integer 
or 


a antes (8.9a) 


Because both m and No are integers, Eq. (8.9a) implies that the sinusoid cos Qk is 
periodic only if 2 is a rational number. In this case the period No is given by [Eq. 
(8.9a)] 


Ksm @ (8.9b) 


To compute No, we must choose the smallest value of m that will make m( 2) 


an integer. For example, if Q = g, then the smallest value of m that will make 


m% = mit an integer is 2. Therefore 


Qn 17 
No =m— =2—=17 
ears 5 


Using a similar argument, we can show that this discussion also applies to a 
discrete-time exponential e/°*, Thus, a discrete-time exponential e7* is periodic 
only if È is a rational number.t 


Physical Explanation of the Periodicity Relationship 


Qualitatively, this result can be explained by recognizing that a discrete-time 
sinusoid cos Qk can be obtained by sampling a continuous-time sinusoid cos Nt at 
unit time interval T = 1; that is, cos Qt sampled at t = 0, 1, 2, 3, .... This fact 


tWe can also demonstrate this point by observing that if e/®k is No-periodic, then 
ik — IUk+No) — ejk gjQNo 


This result is possible only if QNo = 2mm (m, an integer). This conclusion leads to Eq. (8.9b). 


8.2 Some Useful Discrete-time Signal models 549 


41 


cos (0.8k) 


Fig. 8.10 Physical explanation of the periodicity relationship. 


means cos Mt is the envelope of cos Nk. Since the period of cos Nt is 27/2, there 
are 21/2 number of samples (elements) of cos Qk in one cycle of its envelope. This 
number may or may not be an integer. 

Figure 8.10 shows three sinusoids cos (7k), cos (42k), and cos (0.8k). Figure 
8.10a shows cos($k), for which there are exactly 8 samples in each cycle of its 
envelope (3 = 8). Thus, cos (fk) repeats every cycle of its envelope. Clearly, 
cos (4k/7) is periodic with period 8. On the other hand, Fig. 8.10b, which shows 
cos ($k), has an average of a = 8.5 samples (not an integral number) in one cycle 
of its envelope. Therefore, the second cycle of the envelope will not be identical 
to the first cycle. But there are 17 samples (an integral number) in 2 cycles of 
its envelope. Hence, the pattern becomes repetitive every 2 cycles of its envelope. 
Therefore, cos ( irk) is also repetitive but its period is 17 samples (two cycles of its 
envelope). This observation indicates that a signal cos Qk is periodic only if we can 
fit an integral number (No) of samples in m integral number of cycles of its envelope 
so that the pattern becomes repetitive every m cycles of its envelope. Because the 
period of the envelope is a we conclude that 


gem 
oF MIO 


which is precisely the condition of periodicity in Eq. (8.9b). If 2 is irrational, it is 
impossible to fit an integral number (No) of samples in an integral number (m) of 
cycles of its envelope, and the pattern can never become repetitive. For instance, 
the sinusoid cos (0.8k) in Figure 8.10c has an average of 2.57 samples (an irrational 
number) per envelope cycle, and the pattern can never be made repetitive over any 
integral number (m) of cycles of its envelope; so cos (0.8k) is not periodic. 
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A Exercise E8.3 on : 
State with reasons if the following sinusoids are periodic. If periodic, find the period. 
(i) cos(3%k) (ii) cos(42k) (iii) cos (vrk) 
Ans: (i) Periodic: period No = 14. (ii) and (iii) Aperiodic: Q/27 irrational. y 


© Computer Example C8.3 

Sketch and verify if cos (k) is periodic. 

According to Eq. (8.9b), the smallest value of m that will make No = m (%3) = 
m (4) an integer is 3. Therefore, No = 14. This result means cos (3x) is periodic and 
its period is 14 samples in three cycles of its envelop. This assertion can be verified by the 
following MATLAB commands: 

t=-5*pi:pi/100:5*pi; t=t’; 

ft=cos(3*pi*t/7); 

plot(t,ft,?:’), hold on 

k=-15:15; k=k’; 

fk=cos(k*3*pi/7); 

stem(k,fk), hold off © 


2 Nonuniqueness of Discrete-Time Sinusoid Waveforms 


A continuous-time sinusoid cos wt has a unique waveform for every value of w 
in the range 0 to oo. Increasing w results in a sinusoid of ever increasing frequency. 
Such is not the case for the discrete-time sinusoid cos Nk because 


cos (Q + 2nm)k = cos (Qk + 2rmk) 


Now, if m is an integer, mk is also an integer, and the above equation reduces to 
cos (N + 2mm)k = cos Nk m integer (8.10) 


This result shows that a discrete-time sinusoid of frequency Q is indistinguishable 
from a sinusoid of frequency Q plus or minus an integral multiple of 27. This 
statement certainly does not apply to continuous-time sinusoids. 

This result means that discrete-time sinusoids of frequencies separated by in- 
tegral multiples of 27 are identical. The most dramatic consequence of this fact is 
that a discrete-time sinusoid cos (Nk +6) has a unique waveform only for the values 
of Q over a range of 27. We may select this range to be 0 to 27, or m to 37, or even 
—n to x. The important thing is that the range must be of width 27. A sinusoid 
of any frequency outside this interval is identical to a sinusoid of frequency within 
this range of width 27. We shall select this range —7 to 7 and call it the funda- 
mental range of frequencies. Thus, a sinusoid of any frequency 2 is identical 
to some sinusoid of frequency Qy in the fundamental range —r to m. Consider, for 
example, sinusoids of frequencies Q = 8.7m and 9.67. We can add or subtract any 
integral multiple of 27 from these frequencies and the sinusoids will still remain 
unchanged. To reduce these frequencies to the fundamental range (—r to 7), we 
need to subtract 4 x 2r = 8r from 8.7m and subtract 5 x 2r = 10” from 9.67, to 
yield frequencies 0.77 and —0.47, respectively. Thus 


cos (8.77k + 0) = cos (0.77k + 0) 
cos (9.6rk + 6) = cos (—0.47k + 0) (8.11) 
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This result shows that a sinusoid cos(Qk + 6) can always be expressed as 
cos (Qsk +6), where =r < Qp < r (the fundamental frequency range). The reader 
should get used to the fact that the range of discrete-time frequencies is only 2r. 
We may select this range to be from —z to ~ or from 0 to 27, or any other interval of 
width 2r. It is most convenient to use the range from —r to 7. At times, however, 
we shall find it convenient to use the range from 0 to 27. Thus, in the discrete-time 
world, frequencies can be considered to lie only in the fundamental frequency range 
(from —r to 7, for instance). Sinusoids of frequencies outside the fundamental 
frequencies do exist technically. But physically, they cannot be distinguished from 
the sinusoids of frequencies within the fundamental range. Thus, a discrete-time 
sinusoid of any frequency, no matter how high, is identical to a sinusoid of some 
frequency within the fundamental range (—r to T). 

The above results, derived for discrete-time sinusoids, are also applicable to 
discrete-time exponentials of the form e/%*, For example 

ed (Q420m)k = ejk tj2mmk = ith m, integer (8.12) 
Here we have used the fact that e*/?™" = 1 for all integral values of n. This result 


means that discrete-time exponentials of frequencies separated by integral multiples 
of 27 are identical. 


Further Reduction in the Frequency Range of Distinguishable Discrete-Time 
Sinusoids 


We shall now show that the range of frequencies that can be distinguished can 
be further reduced from (—7, 7) to (0, 7). According to Eq. (8.6), cos(—Qk +6) = 
cos (Qk —8). In other words, the frequencies in the range (0 to —7) can be expressed 
as frequencies in the range (0 to r) with opposite phase. For example, the second 
sinusoid in Eq. (8.11) can be expressed as 


cos (9.67k + 6) = cos (—0.47k + 8) = cos (0.4rk — 6) (8.13) 


This result shows that a sinusoid of any frequency 2 can always be expressed as a 
sinusoid of a frequency |Q;|, where |Q f| lies in the range 0 to 7. Note, however, a 
possible sign change in the phases of the two sinusoids. In other words, a discrete- 
time sinusoid of any frequency, no matter how high, is identical in every respect to 
a sinusoid within the fundamental frequency range, such as —r to 7. In contrast, a 
discrete-time sinusoid of any frequency, no matter how high, can be expressed, with 
a possible sign change in phase, as a sinusoid of frequency in the range (0, r); that 
is, within half the fundamental frequency range. 

A systematic procedure to reduce the frequency of a sinusoid cos (Qk + 8) is to 
express Q ast 


N= NF + 2m s| <r, and m an integer (8.14) 


This procedure is always possible. The reduced frequency of the sinusoid cos (Qk+6) 
is then |Q,|. 


TEquation (8.14) can also be expressed as 2 f= QQ 


modulo 27 


552 8 Discrete-time Signals and Systems 


E Example 8.1 

Consider sinusoids of frequencies Q equal to (a) 0.5m (b) 1.6m (c) 2.5m (d) 5.6m (e) 
34.116. Each of these sinusoids is equivalent to a sinusoid of some frequency |Q;| in the 
range 0 to 7. We shall now determine these frequencies. This goal is readily accomplished 
by expressing the frequency 2 as in Eq. (8.14). 

(a) The frequency 0.57 is in the range (0 to ) so that it cannot be reduced further. 

(b) The frequency 1.67 = 2r — 0.4%, and Q f = —0.4r. Therefore, a sinusoid of 
frequency 1.64 can be expressed as a sinusoid of frequency |Qy| = 0.47. 

(c) 2.57 = 2r + 0.57, and Q = 0.57. Therefore, a sinusoid of frequency 2.57 can be 
“expressed as a sinusoid of frequency |Q;| = 0.57. 

(d) 5.67 = 3(27) — 0.4m, and Q; = —0.4r. Therefore, a sinusoid of frequency 5.67 
can be expressed as a sinusoid of frequency || = 0.47. 

(e) 34.116 = 5(2r) + 2.7, and Np = 2.7. Therefore, a sinusoid of frequency 34.116 
can be expressed as a sinusoid of frequency |Q5| = 2.7. W 


The fundamental range frequencies can be determined by using a simple graphi- 
cal artifice as follows: mark all the frequencies on a tape using a linear scale, starting 
with zero frequency. Now wind this tape continuously around the two poles, one 
at |Q7| = 0 and the other at |Q;7| = x, as illustrated in Fig. 8.11. The reduced 
value of any frequency marked on the tape is its projection on the horizontal (gzl) 
axis. For instance, the reduced frequency corresponding to 2 = 1.6r is 0.47 (the 
projection of 1.67 on the horizontal Np axis). Similarly, frequencies 2.57, 5.67, and 
34.116 correspond to frequencies 0.57, 0.4m, and 2.7 on the |Q,| axis. 


^A Exercise E8.4 

Show that the sinusoids of frequencies Q = (a) 2m (b) 3m (c) 5a (d) 3.2m (ec) 22.1327 (f) r+2 
can be expressed as sinusoids of frequencies (a)0 (b) a (c)m (d)0.8m (e)3 (f)  —2, respectively. 
Vv: 
A Exercise E8.5 

Show that a discrete-time sinusoid of frequency m + x can be expressed as a sinusoid with 
frequency m — x (0 <a < r). This fact shows that a sinusoid with frequency above 7 by amount 
x has the frequency identical to a sinusoid of frequency below by the same amount z, and the 
maximum rate of oscillation occurs at Q = m. As Q increases beyond ~r, the rate of oscillation 
actually decreases. Y. 


© Computer Example C8.4 

In the fundamental range of frequencies from —r to r find a sinusoid that is indis- 
tinguishable from the sinusoid cos ( Fk). Verify by plotting these two sinusoids that they 
are indeed identical. 

The sinusoid cos (3k) is identical to the sinusoid cos (= - 2r) = cos (4 ) = 
cos (35k). We may verify that these two sinusoids are identical. 


k=-15:15; k=k’; 
fk1=cos(3*pi*k/7); 
fk2=cos(11*pi*k/7); 
stem(k,fk1,’x’),hold on, 
stem(k,fk2),hold off © 


Physical Explanation of Nonuniqueness of Discrete-Time Sinusoids 


Nonuniqueness of discrete-time sinusoids is easy to prove mathematically. But 
why does it happen physically? We now give here two different physical explanations 
of this intriguing phenomenon. 
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The First Explanation 


Recall that sampling a continuous-time sinusoid cos Qt at unit time intervals 
(T = 1) generates a discrete-time sinusoid cos Qk. Thus, by sampling at unit 
intervals, we generate a discrete-time sinusoid of frequency Q (rad/sample) from 
a continuous-time sinusoid of frequency Q (rad/s). Superficially, it appears that 
since a continuous-time sinusoid waveform is unique for each value of 2, the result- 
ing discrete-time sinusoid must also have a unique waveform for each 2. Recall, 


however, that there is a unit time interval between samples. If a continuous-time 


between successive samples), it 


time sinusoid could also give the 


i S l s of two very different continuous- 
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Fig. 8.12 Physical explanation of nonuniqueness of Discrete- 


i 


time sinusoid waveforms. 


554 8 Discrete-time Signals and Systems 


Human Eye is a Lowpass Filter 


Figure 8.12 also brings out one interesting fact; that a human eye is a lowpass 
filter. Both the continuous-time sinusoids in Fig. 8.12 have the same set of sam- 
ples. Yet, when we see the samples, we interpret them as the samples of the lower 
frequency sinusoid. The eye does not see (or cannot reconstruct) the wiggles of the 
higher frequency sinusoid between samples because the eye is basically a lowpass 
filter. 
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Fig. 8.13 Another physical explanation of nonuniqueness of discrete-time sinusoid wave- 
forms. 


The Second Explanation 


Here we shall present a quantitative argument using a discrete-time exponential 
rather than a discrete-time sinusoid. As explained earlier, a discrete-time exponen- 
tial e?°* can be viewed as a phasor rotating counterclockwise at a uniform angular 
velocity of 2 rad/sample, as shown in Fig. 8.7a. A similar argument shows that the 
exponential e~/@* is a phasor rotating clockwise at a uniform angular velocity of 
N radians per sample, as depicted in Fig. 8.7b. The angular velocity of both these 
rotating phasors is Q rad. Therefore, as the frequency © increases, the angular ve- 
locity also increases. This, however, is true only for values of Q in the range 0 to 7. 
Something very interesting happens when the frequency 2 increases beyond r. Let 
Q =x +z where x < 7. Figure 8.13a shows the phasor progressing from k = 0 to 
k = 1, and Fig. 8.13b shows the same phasor progressing from k = 1 to k = 2. Be- 
cause the phasor rotates at a speed of Q = r +2 radians/sample, the phasor angles 
at k = 0, 1, and 2 are 0, r+ a and 2r + 2z = 2z, respectively. In both the figures, 
the phasor is progressing counterclockwise at a velocity of (t +z) rad/sample. But 
we may also interpret this motion as the phasor moving clockwise (shown in gray) 
at a lower speed of (r — z) rad/sample. Either of these interpretations describes 
the phasor motion correctly. If this motion could be seen by a human eye, which 
is a lowpass filter, it will automatically interpret the speed as 7 — x, the lower of 
the two speeds. This is the stroboscopic effect observed in movies, where at certain 
speeds, carriage wheels appear to move backwards.t 


+A stroboscope is a source of light that flashes periodically on an object, thus generating a sampled 
image of that object. When a stroboscope flashes on a rotating object, such as a wheel, the wheel 
appears to rotate at a certain speed. Now increase the actual speed of rotation (while maintaining 
the same flashing rate). If the speed is increased beyond some critical value, the wheels appear 
to rotate backwards because of the lowpass filtering effect described above in the text. As we 
continue to increase the speed further, the backward rotation appears to slow down continuously 
to zero speed (where the wheels appear stationary), and reverse the direction again. This effect is 
often observed in movies in scenes with running carriages. A movie reel consists of a sequence of 
photographs shot at discrete instants, and is basically a sampled signal. 
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Thus, in a signal e?°*, the frequency Q = r +2 appears as frequency r — z. 
Therefore, as 2 increases beyond r, the actual frequency decreases, until at Q = 2r 
(z = r), the actual frequency is zero (r — z = 0). As we increase 2 beyond 27, the 
same cycle of events repeats. For instance, 2 = 2.57 is the same as 2 = 0.57. 


cos (Ok ) or cos (27k) 


Fig. 8.14 Highest Oscillation Rate in a Discrete-Time sinusoid occurs at Q = r. 


Highest Oscillation Rate in a Discrete-Time Sinusoid Occurs at Q = r 


This discussion shows that the highest rate of oscillation occurs for the fre- 
quency Q = 7. The rate of oscillation increases continuously as Q increases from 
0 to 7, then decreases as Q increases from r to 27. Recall that a frequency 7 +z 
appears as the frequency 7 — x. The frequency 2 = 2r (z = a) is the same as the 
frequency Q = 0 (constant signal). These conclusions can be verified from Fig. 8.14, 


which shows sinusoids of frequencies 2 = (a) 0 or 2r (b) gor ir (c) Z or 3% (d) r. 


6. Exponentially Varying Discrete-Time Sinusoid +* cos (Qk + 8) 


This isa sinusoid cos (Qk +6) with an exponentially varying amplitude 7*. It is 
obtained by multiplying the sinusoid cos (Qk +0) by an exponential y*. Figure 8.15 
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(0.9)* cos (Fk -%) 


-5} (b) 


Fig. 8.15 Examples of exponentially varying discrete-time sinusoids. 


shows signals (0.9)* cos (Fk — 3), and (1.1)* cos (Zk — §). Observe that if |y] < 1, 
the amplitude decays, and if |y| > 1, the amplitude grows exponentially. 


8.2-1 Size of a Discrete-Time Signal 


Arguing along the lines similar to those used in continuous-time signals, the 
size of a discrete-time signal f[k] will be measured by its energy E ș defined by 


Es= D> Isle? (8.15) 


k=-00 


This definition is valid for real or complex f[k]. For this measure to be meaningful, 
the energy of a signal must be finite. A necessary condition for the energy to be 
finite is that the signal amplitude must — 0 as |k| > oo. Otherwise the sum in Eq. 
(8.15) will not converge. If Ey is finite, the signal is called an energy signal. 

In some cases, for instance, when the amplitude of f[k] does not — 0 as |k| > 
oo, then the signal energy is infinite, and a more meaningful measure of the signal 
in such a case would be the time average of the energy (if it exists), which is the 
signal power Py defined by 


N 
ase 1 : 
Pro jim awa 2 Isik] (8.16) 


For periodic signals, the time averaging need be performed only over one period in 
view of the periodic repetition of the signal. If Pș is finite and nonzero, the signal is 
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called a power signal. As in the continuous-time case, a discrete-time signal can 
either be an energy signal or a power signal, but cannot be both at the same time. 
Some signals are neither energy nor power signals. 
A Exercise E8.7 

(a) Show that the signal a*u[k] is an energy signal of energy +} if la] < 1. It isa power 


1-[a] 
signal of power Py = 0.5 if |a| = 1. It is neither an energy signal nor a power signal if |a| > 1. y 


8.3 Sampling Continuous-Time Sinusoid and Aliasing 


On the surface, the fact that discrete-time sinusoids of frequencies differing by 
2nm are identical may appear innocuous. But in reality it creates a serious problem 
for processing continuous-time signals by digital filters. A continuous-time sinusoid 
f(t) = cos wt sampled every T seconds (t = kT) results in a discrete-time sinusoid 
f{k] = cos wkT. Thus, the sampled signal f|k] is given by 


f{k] = cos wkT 
cos Qk where Q = wT 


li 


Recall that the discrete-time sinusoids cos Nk have unique waveforms only for the 
values of frequencies in the range Q < m or wT < r (fundamental frequency range). 
We know that a sinusoid of frequency 2 > 7 appears as a sinusoid of a lower 
frequency 2 < m. For a sampled continuous-time sinusoid, this fact means that 
samples of a sinusoid of frequency w > 1/T appear as samples of a sinusoid of 
lower frequency w < 7/T. The mechanism of how the samples of continuous-time 
sinusoids of two (or more) different frequencies can generate the same discrete- 
time signal is shown in Fig. 8.12. This phenomenon is known as aliasing because, 
through sampling, two entirely different analog sinusoids take on the same “discrete- 
time” identity. 

Aliasing causes ambiguity in digital signal processing, which makes it impos- 
sible to determine the true frequency of the sampled signal. Therefore, aliasing 
is highly undesirable and should be avoided. To avoid aliasing, the frequencies 
of the continuous-time sinusoids to be processed should be kept within the range 
wT <n orw <2/T. Under this condition, the question of ambiguity or aliasing 
does not arise because any continuous-time sinusoid of frequency in this range has 
a unique waveform when it is sampled. Therefore, if wp is the highest frequency to 


be processed, then, to avoid aliasing, 
wh L (8.17a) 


If F, is the highest frequency in Hertz, Fa = wh /2n, and, according to Eq. (8.17a), 


1 
Fh S zz (8.17b) 
or 
r<- (8.17¢) 
~ 2Fp igs 


This result shows that discrete-time signal processing places the limit on the highest 
frequency Fp that can be processed for a given value of the sampling interval T 
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according to Eq. (8.17b). But we can process a signal of any frequency (without 
aliasing) by choosing a sufficiently low value of T according to Eq. (8.17c). The 
sampling rate or sampling frequency F, is the reciprocal of the sampling interval 
T, and, according to Eq. (8.17c),+ 


> 2Fp (8.18) 


This result, which is a special case of the sampling theorem (proved in Chapter 
5), states that to process a continuous-time sinusoid by a discrete-time system, the 
sampling rate must not be less than twice the frequency (in Hz) of the sinusoid. In 
short, a sampled sinusoid must have a minimum of two samples per cycle. 
For a sampling rate below this minimum value, the output signal will be aliased, 
which means the signal will be mistaken for a sinusoid of lower frequency. 

Equation 8.18 indicates that Fh, the highest frequency that can be processed, 
is half the sampling frequency Fs. This means the range of frequencies that can be 
processed without aliasing is from 0 to F,/2 


0<F< 2 (8.19) 


Frequencies greater than F,/2 (half the sampling frequency) will be aliased and 
appear as frequencies lower than F,/2. The aliasing appears as a folding back 
of frequencies about F,/2. Hence, this frequency is also known as the folding 
frequency. The details of this folding are explained more fully in Fig. 5.6. 

The folding process is multilayered, as depicted in Fig. 8.11. The spectrum 
first folds back at the folding frequency, and then again folds forward at the origin, 
then back again at the folding frequency, and so on. We can find the aliased 
frequency (the reduced frequency) using an equation similar to Eq. (8.14) applicable 
to sampled continuous-time sinusoids. 

We saw that a continuous-time sinusoid of frequency w appears as a discrete- 
time sinusoid of frequency Q = wT. Hence, if w f is the reduced (aliased) frequency 
corresponding to a sinusoid of frequency w, then, according to Eq. (8.14) 


wT =w;sT + drm lws|[T <r, and m an integer (8.20) 


When we express the radian frequencies in Hertz (w = 2nF, etc.), and use the fact 
that the sampling frequency F, = +, Eq. (8.20) becomes 


F=FftmFfs, |Fyl< Ze, and m an integer (8.21) 


Thus, if a continuous-time sinusoid of frequency F Hz is sampled at a rate of F, 
Hz (samples/second), the resulting samples would appear as if they had come from 
a continuous-time sinusoid of a lower (aliased) frequency |F |. For instance, if 
a continuous-time sinusoid of frequency 10 kHz were sampled at a rate of 3 kHz 
(3000 samples/second), the resulting samples will appear as if they had come from 
a continuous-time sinusoid of frequency 1 kHz because 10,000 = 1,000 + 3(3000). 
Note, however, if the frequency of a sinusoid is less than the folding frequency F,/2 
(half the sampling frequency), there is no aliasing. Thus, the condition for the 
absence of aliasing is that the frequency of a sinusoid must be less than half the 
sampling frequency (the folding frequency). 


tIn some special cases, where the signal spectrum contains an impulse at Fp, the sampling rate 
Fs must be greater than 2F, (see footnote on p.321) 
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E Example 8.2 

Determine the maximum sampling interval T that can be used in a discrete-time 
oscillator which generates a sinusoid of 50 kHz. 

Here the highest frequency Fa = 50 kHz. Therefore, according to Eq. (8.17c) 


1 
T < — = 
SIA, 10 ps 


The sampling interval must not be greater than 10 us. The minimum sampling frequency 
is Fz = 4 = 100 kHz. If we use T = 10 ys, the oscillator output will exhibit two samples 
per cycle. If we require the oscillator output to have 20 samples per cycle, then we must 
use T = 1 ys (sampling frequency F, = 1 MHz). E 


E Example 8.3 
A discrete-time amplifier uses a sampling interval T = 25 us. What is the highest 
frequency of a signal that can be processed with this amplifier without aliasing? 
According to Eq. (8.17b) 


1 
Fh = zy = 20 kHz E 


E Example 8.4 

A sampler with sampling interval T = 0.001 second (1 ms.) samples continuous-time 
sinusoids of the following frequencies: (a) 400 Hz (b) 1 kHz (c) 1.4 kHz (d) 1.6kHz (e) 
3.522 kHz. Determine the aliased frequencies of the resulting sampled signals. 

The sampling frequency is Fs = 1/T = 1,000. The folding frequency F,/2 = 500. 
Hence, sinusoids below 500 Hz will not be aliased and sinusoids of frequency above 500 Hz 
will be aliased. Using Eq. (8.21), we find: 

(a) 400 Hz is less than 500 Hz (the folding frequency, which is half the sampling 
frequency Fs). Hence, there is no aliasing. 

(b) 1000 = 0+ 1000 so that Fs = 0 and the aliased frequency (|F |) is zero. The 
sampled signal appears as samples of a dc signal. 

(c)1400 = 400 + 1000 so that Ff = 400 and the aliased frequency (|F¥|) is 400 Hz. 
The sampled signal appears as samples of a signal of frequency 400 Hz. 

(d) 1600 = —400 + 2(1000) so that Fp = —400 and the aliased frequency (|Fy|) is 400 
Hz. The sampled signal appears as samples of a signal of frequency 400 Hz. 

(e) 3522 = —478 + 4(1000) so that Ff = —478 and the aliased frequency (|Fy|) is 478 
Hz. The sampled signal appears as samples of a signal of frequency 478 Hz. 

Graphically, we can solve this problem using the artifice in Fig. 8.11. The folding 
frequency is 500 Hz instead of r. In case (a), the frequency 400 Hz is below the folding 
frequency 500 Hz. Hence, the samples of this sinusoid will not be aliased. For case (b), the 
frequency 1000 Hz, when folded back at 500 Hz terminates at the origin F = 0. Hence, 
the aliased frequency is 0. For case (c), the frequency 1400 Hz folds back at 500 Hz, then 
folds forward at 0, and terminates at 400 Hz. Similarly, for case (d), the frequency 1600 
Hz folds back at 500, then folds forward at 0, and folds back again at 500 Hz to terminate 
at 400 Hz, and so on. | | 


8.4 Useful Signal Operations 


Signal operations discussed for continuous-time systems also apply to discrete- 
time systems with some modification in time scaling. Since the independent variable 
in our signal description is time, the operations are called time shifting, time in- 
version (or time reversal), and time scaling. However, this discussion is valid for 
functions having independent variables other than time (e.g., frequency or distance). 
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Fig. 8.16 Time-shifting and time inversion of a signal. 


8.4-1 Time Shifting 


Following the argument used for continuous-time signals, we can show that 
to time shift a signal f[k] by m units, we replace k with k — m. Thus, f[k — m] 
represents f [k] time shifted by m units. If m is positive, the shift is to the right 
(delay). If m is negative, the shift is to the left (advance). Thus, f[k — 2] is f[{k] 
delayed (right-shifted) by 2 units, and f[k + 2] is f[k] advanced (left-shifted) by 
2 units. The signal falk] in Fig. 8.16b, being the signal in Fig. 8.16a delayed by 
5 units, is the same as f[k] with k replaced by k — 5. Now, f{k] = (0.9)* for 
3 <k < 10. Therefore, falk] = (0.9)*-5 for 3 <k-5 < 100r8 < k < 15, as 
illustrated in Fig. 8.16b. 


8.4-2 Time Inversion (or Reversal) 


Following the argument used for continuous-time signals, we can show that 
to time invert a signal f{k], we replace k with —k. This operation rotates the 
signal about the vertical axis. Figure 8.16c shows f,{k], which is the time-inverted 
signal f{k] in Fig. 8.16a. The expression for f,[k] is the same as that for f[k] with 
k replaced by —k. Because f[k] = (0.9)* for 3 < k < 10, fr[k] = (0.9)—* for 
3 < —k < 10; that is, -3 > k > —10 , as shown in Fig. 8.16c. 
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8.4-3 Time Scaling 


Following the argument used for continuous-time signals, we can show that to 
time scale a signal f[k] by a factor a, we replace k with ak. However, because 
the discrete-time argument k can take only integral values, certain restrictions and 
changes in the procedure are necessary. 


Time Compression: Decimation or Downsampling 


Consider a signal 
folk] = f[2k] (8.22) 


The signal f,{k] is the signal f[k] compressed by a factor 2. Observe that fe[0] = 
f(0], fe{1] = Ff[2], f-[2] = f[4], and so on. This fact shows that f,[k] is made 
up of even numbered samples of f{k]. The odd numbered samples of f[k] are 
missing (Fig. 8.17b).{ This operation loses part of the data, and that is why such 
time compression is called decimation or downsampling. In the continuous-time 
case, time compression merely speeds up the signal without loss of data. In general, 
f[mk] (m integer) consists of only every mth sample of f [k]. 


Time Expansion 
Consider a signal 
k 

rele = 1 [3 (8.23) 
The signal f.[k] is the signal f [k] expanded by a factor 2. According to Eq. (8.23), 
fel0] = f[0], fef] = [1/2], fel2] = f[1], fel3] = F[3/2], fel4] = f[2], fel5] = 
f(5/2], fe[6] = [3], and so on. Now, f[k] is defined only for integral values of 
k, and is zero (or undefined) for all fractional values of k. Therefore, for f,[k], its 
odd numbered samples fef], fe[3], fe[5], ... are all zero (or undefined), as depicted 
in Fig. 8.17c. In general, a function fe[k] = f[k/m] (m integer) is defined for 


= 0, tm, +2m, 43m, ..., and is zero (or undefined) for all remaining values of 
k. 


Interpolation 


In the time-expanded signal in fig. 8.17c, the missing odd numbered samples can 
be reconstructed from the nonzero valued samples using some suitable interpolation 
formula. Figure 8.17d shows such an interpolated function f;[k], where the missing 
samples are constructed using an ideal lowpass filter interpolation formula (5.10b). 
In practice, we may use a realizable interpolation, such as a linear interpolation, 
where f;{1] is taken as the mean of f;[0] and f:[2). Similarly, f;[3] is taken as the 
mean of fi[2] and f;[4], and so on. This process of time expansion and inserting the 
missing samples using an interpolation is called interpolation or upsampling. In 
this operation, we increase the number of samples. 


A Exercise E8.6 

Show that for a linearly interpolated function f;[k] = f[{k/2], the odd numbered samples 
interpolated values are f;[k] = 3 {fF} + f(y}. 7 
{Odd numbered samples of f{k] can be retained (and even numbered samples omitted) by using 


the transform 
felk] = fl2k + 1] 
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Fig. 8.17 Time compression (decimation) and time expansion (interpolation) of a signal. 


8.5 Examples of Discrete-Time Systems 


We shall give here three examples of discrete-time systems. In the first two ex- 
amples, the signals are inherently discrete-time. In the third example, a continuous- 
time signal is processed by a discrete-time system, as illustrated in Fig. 8.2, by 
discretizing the signal through sampling. 


E Example 8.5 

A person makes a deposit (the input) in a bank regularly at an interval of T (say, 1 
month). The bank pays a certain interest on the account balance during the period T and 
mails out a periodic statement of the account balance (the output) to the depositor. Find 
the equation relating the output yl[k] (the balance) to the input f{k] (the deposit). 
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In this case, the signals are inherently discrete-time. Let 


fÍk] =the deposit made at the kth discrete instant 
ylk] =the account balance at the kth instant computed 
immediately after the kth deposit f[k] is received 
r = interest per dollar per period T 


The balance y[k] is the sum of (i) the previous balance ylk — 1], (ii) the interest on y[k — 1] 
during the period T, and (iii) the deposit fik) 


ylk] =ylk — 1) + ryfk — 1) + f[k] 
=(1 +r)yík — 1] + fik} (8.24) 
yik] — ay[k — 1] = fik] a=1+r (8.25a) 


In this example the deposit f[k] is the input (cause) and the balance ylk] is the output 
(effect). 

We can express Eq. (8.25a) in an alternate form. The choice of index k in Eq. (8.25a) 
is completely arbitrary, so we can substitute k + 1 for k to obtain 


ylk + 1) — ayik] = fik + 1) (8.25b) 


We also could have obtained Eq. (8.25b) directly by realizing that ylk + 1}, the balance at 
the (k + 1)st instant, is the sum of y{k] plus ry[k] (the interest on y{k]) plus the deposit 
(input) f[k + 1] at the (k + 1)st instant. 

For a hardware realization of such a system, we rewrite Eq. (8.25a) as 


lk] = ay[k — 1] + fik) (8.25c) 


Figure 8.18 shows the hardware realization of this equation using a single time delay of T 
units.t To understand this realization, assume that ylk] is available. Delaying it by T, we 
generate y[k — 1]. Next, we generate yk] from f [k] and y[k — 1] according to Eq. (8.25c). 


fiki y [k] 


Fig. 8.18 Realization of the savings account system. 


A withdrawal is a negative deposit. Therefore, this formulation can handle deposits 
as well as withdrawals. It also applies to a loan payment problem with the initial value 
y[0] = —M, where M is the amount of the loan. A loan is an initial deposit with a negative 
value. Alternately, we may treat a loan of M dollars taken at k = 0 as an input of -M at 
k = 0 [see Prob. 9.4-9]. W 


{The time delay in Fig. 8.18 need not be T. The use of any other value will result in a time-scaled 
output. 
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yik) 


JIk) 


Fig. 8.19 Realization of a second-order discrete-time system in Example 8.6. 


a Example 8.6 

In the kth semester, f[k] number of students enroll in a course requiring a certain 
textbook. The publisher sells y{k] new copies of the book in the kth semester. On the 
average, one quarter of students with books in saleable condition resell their books at the 
end of the semester, and the book life is three semesters. Write the equation relating y{k], 
the new books sold by the publisher, to f [k], the number of students enrolled in the kth 
semester, assuming that every student buys a book. 

In the kth semester, the total books f {k] sold to students must be equal to ylk] (new 
books from the publisher) plus used books from students enrolled in the two previous 
semesters (because the book life is only three semesters). There are ylk — 1] new books 
sold in the (k — 1)st semester, and one quarter of these books; that is, dylk — 1] will be 
resold in the kth semester. Also, y[k — 2] new books are sold in the (k — 2)nd semester, 
and one quarter of these; that is, dy[k ~ 2] will be resold in the (k — 1)st semester. Again 
a quarter of these; that is, j,y[k — 2] will be resold in the kth semester. Therefore, f|[k] 
must be equal to the sum of y[k], }y[k — 1], and $}yfk — 2]. 


ylk] + 3ulk - 1} + ylk — 2] = fik] (8.26a) 


Equation (8.26a) can also be expressed in an alternative form by realizing that this equation 
is valid for any value of k. Therefore, replacing k by k + 2, we obtain 


ylk + 2] + iyik +1) + ylk] = fik + 2] (8.26b) 


This is the alternative form of Eq. (8.26a). 


For a realization of a system with this input-output equation, we rewrite Eq. (8.26a) 
as 


ylk] = —4ylk — 1] - $ylk — 2] + f[k] (8.26c) 


Figure 8.19 shows a hardware realization of Eq. (8.26c) using two time delays (here the 
time delay T is a semester). To understand this realization, assume that y[k] is available. 
Then, by delaying it successively, we generate y[k — 1] and y[k — 2]. Next we generate y|k] 
from f[k], y[k — 1], and y[k — 2] according to Eq. (8.26c). W 


Equations (8.25) and (8.26) are examples of difference equations; the former is a 
first-order and the latter is a second-order difference equation. Difference equations 
also arise in numerical solution of differential equations. 
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Fig. 8.20 Digital differentiator and its realization. 


@ Example 8.7: Digital Differentiator 

Design a discrete-time system, like the one in Fig. 8.2, to differentiate continuous-time 
signals. Determine the sampling interval if this differentiator is used in an audio system 
where the input signal bandwidth is below 20 kHz. 

In this case, the output y(t) is required to be the derivative of the input f(t). The 
discrete-time processor (system) G processes the samples of f(t) to produce the discrete- 
time output y[k]. Let f[k] and y[k] represent the samples T seconds apart of the signals 
f(t) and y(t), respectively; that is, 


fk] =f(kT) and —y{k] = y(kT) (8.27) 


The signals f[k] and y[k] are the input and the output for the discrete-time system G. 
Now, we require that 


df 
= 8.28 
a=% (8.28) 
Therefore, at t = kT (see Fig. 8.20a) 
df 
kT) = = 
s(kT) dt lt=kT 


ae 
= lim = (f(T) ~ Fe - DT) 
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By using the notation in Eq. (8.27), the above equation can be expressed as 


vik] = lim = {flk] — fik - 1)} 


This is the input-output nr Pi - required to achieve our objective. In practice, 
the sampling interval T cannot be zero. Assuming T to be sufficiently small, the above 
equation can be expressed as 


vlk] = = {fE - fik- 1} (8.29) 
The approximation improves as T approaches 0. A discrete-time processor G to realize 
Eq. (8.29) is shown inside the shaded box in Fig. 8.20b. The system in Fig. 8.20b acts as 
a differentiator. This example shows how a continuous-time signal can be processed by a 
discrete-time system. 
To determine the sampling interval T, we note that the highest frequency that will 
appear at the input is 20 kHz; that is, F» = 20,000. Hence, according to Eq. (8.17c) 


1 

To gain some insight into this method of signal processing, let us consider the differ- 
entiator in Fig. 8.20b with a ramp input f(t) = t, depicted in Fig. 8.20c. If the system 
were to act as a differentiator, then the output y(t) of the system should be the unit step 
function u(t). Let us investigate how the syètem performs this particular operation and 
how well it achieves the objective. 

The samples of the input f(t) = t at the interval of T seconds act as the input to 
the discrete-time system G. These samples, denoted by a compact notation fk], are, 
therefore, 


fik] = f®hexr = thar t>0 
=kT k>0 


Figure 8.20d shows the sampled signal f{k]. This signal acts as an input to the discrete- 
time system G. Figure 8.20b shows that the operation of G consists of subtracting a 
sample from the previous (delayed) sample and then multiplying the difference with 1 /T. 
From Fig. 8.20d, it is clear that the difference between the successive samples is a constant 
kT — (k ~ 1)T = T for all samples, except for the sample at k = 0 (because there is no 
previous sample at k = 0). The output of G is 1/T times the difference T, which is unity 
for all values of k, except k = 0, where it is zero. Therefore, the output ylk] of G consists 
of samples of unit values for k > 1, as illustrated in Fig. 8.20e. The D/C (discrete-time 
to continuous-time) converter converts these samples into a continuous-time signal y(t), 
as shown in Fig. 8.20f. Ideally, the output should have been y(t) = u(t). This deviation 
from the ideal is caused by the fact that we have used a nonzero sampling interval T. As 
T approaches zero, the output y(t) approaches the desired output u(t). if 


A Exercise E8.8 
Design a discrete-time system, such as in Fig. 8.2, to integrate continuous-time signals. 


Hint: If f(t) and y(t) are the input and the output of an integrator, then dy = f(t). Approx- 
imation (similar to that in Example 8.7) of this equation at t = kT yields y[k] — y[k — 1] = Tf[k].- 
Show a realization of this system. Yy 


Practical Realization of Discrete-Time Systems 


‘These examples show that the basic elements required in the realization of 
discrete-time systems are time delays, scalar multipliers, and adders (summers). 
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We show in Chapter 11 that this is generally true of discrete-time systems. The 
discrete-time systems can be realized in two ways: 


1. By using digital computers which readily perform the operations of adding, 
multiplying, and delaying. Minicomputers and microprocessors are well suited 
for this purpose, especially for signals with frequencies below 100 kHz. 


2. By using special-purpose time-delay devices that have been developed in the 
last two decades. These include monolithic MOS charge-transfer devices (CTD) 
such as charge-coupled devices (CCD) and bucket brigade devices (BBD), 
which are implemented on silicon substrate as integrated circuit elements. In 
addition, there are surface acoustic wave (SAW) devices built on piezoelectric 
substrates. Systems using these devices are less expensive but are not as reli- 
able or as accurate as the digital systems. Digital systems are preferable for 
signals below 100 kHz. Systems using CTD are suitable and competitive with 
those using SAW devices in the frequency range 1 kHz to 20 MHz. At frequen- 
cies higher than 20 MHz, SAW devices are preferred and are the only realistic 
choice for frequencies higher than 50 MHz. Systems using SAW devices with 
frequencies in the range of 10 MHz to 1 GHz are implemented routinely.! 


There is a basic difference between continuous-time systems and analog sys- 
tems. The same is true of discrete-time and digital systems. This is fully explained 
in Secs. 1.7-6 and 1.7-7.} For historical reasons, digital computers (rather than time- 
delay elements, such as CCD or SAW devices) were used in the realization of early 
discrete-time systems. Because of this fact, the terms digital filters and discrete- 
time systems are used synonymously in the literature. This distinction is irrelevant 
in the analysis of discrete-time systems. For this reason, in this book, the term dig- 
ital filters implies discrete-time systems, and analog filters means continuous-time 
systems. Moreover, the terms C/D (continuous-to-discrete-time ) and D/C will be 
used interchangeably with terms A/D (analog-to-digital) and D/A, respectively. 


Advantages of Digital Signal Processing 


1. Digital filters have a greater degree of precision and stability. They can be 
perfectly duplicated without having to worry about component value tolerances 
as in analog case. 

2. Digital filters are more flexible. Their characteristics can be easily altered 
simply by changing the program. 

3. A greater variety of filters can be realized by digital systems. 

4. Very low frequency filters, if realized by continuous-time systems, require pro- 
hibitively bulky components. Such is not the case with digital filters. 

5. Digital signals can be stored easily on magnetic tapes or disks without deteri- 
oration of signal quality. 

6. More sophisticated signal processing algorithms can be used to process digital 
signals. 

7. Digital filters can be time shared, and therefore can serve a number of inputs 
simultaneously. 


{The terms discrete-time and continuous-time qualify the nature of a signal along the time axis 
(horizontal axis). The terms analog and digital, in contrast, qualify the nature of the signal 
amplitude (vertical axis). 
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8. Using integrated circuit technology, they can be fabricated in small packages 
requiring low power consumption. 
Some more advantages of using digital signals are listed in Sec. 5.1-3. 


8.6 Summary 


Signals specified only at discrete instants such as t = 0, T, 2T, 3T, ..., kT are 
discrete-time signals. Basically, it is a sequence of numbers. Such a signal may be 
viewed as a function of time t, where the signal is defined or specified only at t = kT 
with k any positive or negative integer. The signal therefore may be denoted as 
F (kT). Alternately, such a signal may be viewed as a function of k, where k is any 
positive or negative integer. The latter approach results in a more compact notation 
such as f(k], which is convenient and easier to manipulate. A system whose inputs 
and outputs are discrete-time signals is a discrete-time system. 

In the study of continuous-time systems, exponentials with the natural base; 
that is, exponentials of the form e**, where À is complex in general, are more natural 
and convenient. In contrast, in the study of discrete-time systems, exponentials with 
a general base; that is, exponentials of the form 7*, where y is complex in general, 
are more convenient. One form of exponential can be readily converted to the other 
form by noting that e** = y*, where y = eò, or \ = lny, and à as well as y 
are complex in general. The exponential y* grows exponentially with k if ly > 1 
(7 outside the unit circle), and decays exponentially if |y| < 1 (y within the unit 
circle). If |y| = 1; that is, if y lies on the unit circle, the exponential is either a 
constant or oscillates with a constant amplitude. 

Discrete-time sinusoids have two properties not shared by their continuous- 
time cousins. First, a discrete-time sinusoid cos Qk is periodic only if 2/27 is 
a rational number. Second, discrete-time sinusoids whose frequencies Q differ by 
an integral multiple of 27 are identical. Consequently, a discrete-time sinusoid of 
any frequency Q is identical to some discrete-time sinusoid whose frequency lies in 
the interval —r to m (called the fundamental frequency range). Further, because 
cos (—Qk+6) = cos (Qk — 90), a sinusoid of a frequency in the range from —7x to 0 can 
be expressed as a sinusoid of frequency in the range 0 to x. Thus, a discrete-time 
sinusoid of any frequency can be expressed as a sinusoid of frequency in the range 0 
to 7. Thus, in practice, a discrete-time sinusoid frequency is at most x. The highest 
rate of oscillation in a discrete-time sinusoid occurs when its frequency is 7. In a 
given time, a sinusoid of frequency other than r will have a fewer number of cycles 
(or oscillations) than the sinusoid of frequency 7. This peculiarity of nonuniqueness 
of waveforms in discrete-time sinusoids of different frequencies has a far reaching 
consequences in signal processing by discrete-time systems. 


One useful measure of the size of a discrete-time signal is its energy defined by 
the sum >, |J [k]|?, if it is finite. If the signal energy is infinite, the proper measure 
is its power, if it exists. The signal power is the time average of its energy (averaged 
over the entire time interval from k = —oo to oo). For periodic signals, the time 
averaging need be performed only over one period in view of the periodic repetition 
of the signal. Signal power is also equa! to the mean squared value of the signal 
(averaged over the entire time interval from k = —oo to 00). 


Sampling a continuous-time sinusoid cos(wt + @) at uniform intervals of T 
seconds results in a discrete-time sinusoid cos (Qk +8), where Q = wT. A continuous 


8.2-1 The following signals are in the form eò. Express them in the form y": (a) e 


Problems 569 


time sinusoid of frequency F Hz must be sampled at a rate no less than 2F Hz. 
Otherwise, the resulting sinusoid is aliased; that is, it appears as a sampled version 
of a sinusoid of lower frequency. 


Discrete-time signals classification is identical to that of continuous-time sig- 
nals, discussed in chapter 1. 


A signal f[k] delayed by m time units (right-shifted) is given by f[k — m]. On 
the other hand, f [k] advanced (left-shifted) by m time units is given by f[k+m]. A 
signal f[k], when time inverted, is given by f[—k]. These operations are the same as 
those for the continuous-time case. The case of time scaling, however, is somewhat 
different because of the discrete nature of variable k. Unlike the continuous-time 
case, where time compression results in the same data at a higher speed, time 
compression in the discrete-time case eliminates part of the data. Consequently, 
this operation is called decimation or downsampling. Time expansion operation of 
discrete-time signals results in time expanding the signal, thus creating zero-valued 
samples in between. We can reconstruct the zero-valued samples using interpolation 
from the nonzero samples. The interpolation, thus, creates additional samples in 
between using the interpolation process. For this reason, this operation is called 
interpolation or upsampling. 


Discrete-time systems may be used to process discrete-time signals, or to pro- 
cess continuous-time signals using appropriate interfaces at the input and output. 
At the input, the continuous-time input signal is converted into a discrete-time sig- 
nal through sampling. The resulting discrete-time signal is now processed by the 
discrete-time system yielding a discrete-time output. The output interface now con- 
verts the discrete-time output into a continuous-time output. Discrete-time systems 
are characterized by difference equations. 


Discrete-time systems can be realized by using scalar multipliers, summers, 
and time delays. These operations can be readily performed by digital comput- 
ers. Time delays also can be obtained from charge coupled devices (CCD), bucket 
brigade devices (BBD), and surface acoustic wave devices (SAW). Several advan- 
tages of discrete-time systems over continuous-time systems are discussed in Sec. 
8.5. Because of these advantages, discrete-time systems are replacing continuous- 
time systems in several applications. 
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—0.5k 


(b) e®5F (c) ei7* (d) ef"™™. In each case show the locations of À and y in the 
complex plane. Verify that an exponential is growing if y lies outside the unit circle 
(or if A lies in the RHP), is decaying if y lies within the unit circle (or if A lies in the 
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LHP), and has a constant amplitude if y lies on the unit circle (or if à lies on the 
imaginary axis). 

Repeat Prob. 8.2-1 for the exponentials (a) e~(+37)* (b) e~G-IME (c) elltim)k 
(d) e(l-im)k (e) e (+5 )k (£) eiF) 

State with reason(s) if the following signals are periodic: (a) cos(0.57k + 0.2) (b) 
cos (V2rk + 1.2) (c) sin (0.5k + 5) (d) e)3* | If periodic, determine the period. 


Repeat Prob. 8.2-3 for the signals (a) cos (0.67k + 0.2) (b) cos(0.8rk + 1.2) (c) 
cos (0.67k + 0.3) + 3sin (0.57k + 0.4) + 8 cos (0.87rk — 35) 

Hint: For parts (a) and (b), use Eq. (8.9b) to determine the period. For part (c), 
if Ni, N2, and Ng are the periods of the three sinusoids, the widths of m1, m2, and 
m3 number of cycles (mi, m2, mg integers) of the three sinusoids must be equal for 
the signal to be periodic. 


Determine the fundamental range frequency 2 '¢ for the sinusoids of the frequencies 
Q = (a)0.8m (b) 1.2% (c)6.9 (d)3.7m (e)22.9%. For each case, determine also the 
lowest frequency which can be used to describe these sinusoids. 


Show that cos (0.6tk + 2) + V3 cos (1.4rk + 3) = 2 cos (0.6rk — Z). 
Express the following exponentials in the form EF (2k+8) where 0 < Q < 2r: 
(a) ej(8-2rk+0) (b) ejink (c) e7 195k (d) 7530.7 xk 

If f[k] = (0.8)*u[k], find the energies of f[k], —f[k], and cf[k). 

Find the energies of the signals depicted in Figs. P8.2-9. 


fik] 


Fig. P8.2-9 
Find the powers of the signals (1)*, (—1)*, u[k], (-1)fufk], and cos [5k + 5]. 
Find the powers of the signals illustrated in Fig. P10.1-4 and P10.1-5 (Chapter 10). 


2r 
Show that the power of a signal DIM" is |D|?. Hence, show that the power of a 
signal 


No-1 No-1 


jr Ze à 
fk] = $7 Dret is P= Sp? 


r=0 r=0 
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8.3-1 


8.3-2 


8.3-3 


8.3-4 


8.4-1 


8.4-2 


8.4-3 


8.4-4 


8.4-5 
8-4-6 


8.5-1 


8.5-2 


8.5-3 


A discrete-time processor uses a sampling interval T = 0.5 us. What is the highest 
frequency of a signal that can be processed with this processor without aliasing? If a 
signal of frequency 2 MHz is sampled by this processor, what would be the (aliased) 
frequency of the resulting sampled signal? 


A sampler with sampling interval is T = 0.1 second samples a continuous-time sinu- 
soids 10 cos (11t + $) and 5 cos(29mt — 4). Find the expressions for the resulting 
discrete-time sinusoids. Hint: Reduce all discrete-time frequencies to the smallest 
value (in the range 0 to 7). 


(a) A signal 10 cos 2000rt + /2sin 3000rt + 2cos (5000rt + +) is sampled at a rate 
of 4000 Hz (4000 samples/second). Find the resulting sampled signal. Does this 
sampling rate cause any aliasing? Explain. 

(b) Determine the maximum sampling interval T that can be used to sample the 
signal in (a) without aliasing. 

A sampler with sampling interval is T = 1074 seconds samples continuous-time sinu- 
soids of the following frequencies: F = (i) 1500 Hz (ii) 8,500 Hz (iii) 10 kHz (iv) 
11.5 kHz (v) 32 kHz (vi) 9600 Hz. Determine of what (continuous-time) frequency 
these samples appear in each case. 


For the signal shown in Fig. P8.2-9b, sketch the signals: (a) f[—k] (b) f[k +6] (c) 
fik - 6] (d) f[3k] (e) f [£] without the interpolation of the missing samples. 


Repeat Prob. 8.4-1 for the signal depicted in Fig. P8.2-9c. 

Sketch the signals (a) ufk — 2] — u[k — 6] (b) k{ufk] — ulk — 7]} (c) (k — 2){ulk — 
2) — ufk —6]} (d)(—k +8){u[k — 6] — u[k — 9]} (e)(k — 2){ulk — 2] — ulk ~ 6]} + (—k + 
8){u[k — 6] — u[k — 9]} 

Describe each of the signals in Fig. P8.2-9 by a single expression valid for all k. 
Hint: Use the expressions of the form in Prob. 8.4-3. 


If the energy of a signal f[k] is Ey, then show that the energy of f[k — m] is also Ey. 


If the power of a periodic signal f[k] is Ps, find the powers and the rms values of (a) 
—f[k] (b) f[-k] (c) f[k-—m] (a) cf[k]. Comment. 


A cash register output y[k] represents the total cost of k items rung up by a cashier. 
The input f[k} is the cost of the kth item. 


(a) Write the difference equation relating y[k] to f [k]. 
(b) Realize this system using a time-delay element. 
(c) Redo the problem if there is a 10% sales tax. 


Let p[k] be the population of a certain country at the beginning of the kth year. 
The birth and death rates of the population during any year are 3.3% and 1.3%, 
respectively. If i[k] is the total number of immigrants entering the country during the 
kth year, write the difference equation relating p[k + 1], p[k], and i{k]. 
Hint: Assume that the immigrants enter the country throughout the year at a uniform 
rate, so that their average birth and death rates need to be averaged. 


For an integrator, the output y(t) is the area under the input f(t) from t = 0 to t. 
Show that the equation of a digital integrator is 


vik] — ylk — 1] = TF[k ~ 1] 


If an input u[k! is applied to such an integrator, show that the output is a ramp 
kT ujk]. Hint: £t k = 0, 1, 2, 3,... successively in this equation to find y[k]. 
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In Exercise E8.8, using a slightly different approach, we found the integrator equation 
to be y[k] — y[k — 1] = Tf[k]. Show that the Tesponse of this integrator to a unit step 
input ufk] is kT uk] + T u{k], which approaches the ramp kT u[k] as T — 0. 


8.5-4 A moving average is used to detect a trend of a rapidly fluctuating variable such as 
the stock market average. A variable may fluctuate (up and down) daily, masking 
its long-term (secular) trend. We can discern the long-term trend by smoothing or 
averaging the past N values of the variable. For the stock market average, we may 
consider a five-day moving average y[k] to be the mean of the past five days’ market 
closing values f[k], f[k — lj,..., fk ~ 4]. 

(a) Write the difference equation relating y[k] to the input f[k]. 
(b) Using time-delay elements, realize the five-day moving average filter. 


R 
a be | 


8.5-5 The voltage at the kth node of a resistive ladder in Fig. P8.5-5 is vfk] 
(k= 0,1,2,...,N ). Show that v[k] satisfies the second-order difference equation 


Fig. P8.5-5 


vik + 2] — Av[k + 1] + ofk] = 0 A=241 


Hint: Consider the node equation at the kth node with voltage vk]. 


Time-Domain Analysis of 
Discrete-Time Systems 


In this chapter we discuss time-domain analysis of LTID (linear time-invariant 
discrete-time systems). The procedure is parallel to that for continuous-time sys- 
tems, with minor differences. 


9.1 Discrete-Time System equations 


Difference Equations 

Equations (8.25), (8.26), and (8.29) are examples of difference equations. Equa- 
tions (8.25) and (8.29) are first-order difference equations, and Eq. (8.26) is a 
second-order difference equation. All these equations are linear, with constant (not 
time-varying) coefficients. Before giving a general form of an nth-order difference 
equation, we recall that a difference equation can be written in two forms; the first 
form uses delay terms such as ylk — 1], yik — 2], f[k — 1}, f[k — 2], ..., etc., and the 
alternate form uses advance terms such as y[k+1], y[k+2], ..., etc. Both forms are 
useful. We start here with a general nth-order difference equation, using advance 
operator form: 


ylk +n) + ap_iy[k +n — 1] +--+- +ay[k +1] + aoy[k] = 
bmf[k +m] + bm—aflk +m — +--+ bi fk +1] + bof] (9.1) 


Observe that the coefficient of ylk +n] can be assumed to be unity without loss 
of generality. If this coefficient is other than unity, we can divide the equation 
throughout by the value of the coefficient of y[k + n] to normalize the equation to 
the form in (9.1). 


Causality Condition 

The left-hand side of Eq. (9.1) consists of the output at instants k +n, k+n-1, 
k +n — 2, and so on. The right-hand side of Eq. (9.1) consists of the input at in- 
stants k+m,k+m~1,ktm— 2, and so on. For a causal system the output cannot 
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depend on future input values. This fact shows that when the system equation is in 
the advance operator form (9.1), the causality requires m < n. Fora general causal 
case, m = n, and Eq. (9.1) can be expressed as 


ylk +n] + an—1y[k +n — 1] +--+ ayik + 1] + agy[k] = 
baflk +n] + bniflk +n- Ut---+brf[k+ 1p + bof [k] (9.2a) 
where some of the coefficients on both sides can be zero. However, the coefficient of 
a[k+n] is normalized to unity. Equation (9.2a) is valid for all values of k. Therefore, 
the equation is still valid if we replace k by k — n throughout the equation [see 
Eqs. (8.25a) and (8.25b)]. Such replacement yields the alternative form (the delay 
Operator form) of Eq. (9.2a): 
vlk] + @n_iy[k = Wt... + ayy[k —n + 1] + agy[k — n] = 
bn fk] + ba-if[k — Wt... + biflk — n + 1] + bof fk — n] (9.2b) 


We shall designate Form (9.2a) the advance operator form, and Form (9.2b) the 
delay operator form. 


9.1-1 Initial Conditions and Iterative Solution of Difference Equations 
Equation (9.2b) can be expressed as 
ylk] = ~an_iy[k - 1] ~ an_oy[k - 2] — --- — agy[k — n] 
+ bn flk] + bn—1f lk ~ 1] +--+ + bof[k — n] (9.2c) 


This equation shows that ylk], the output at the kth instant, is computed from 2n+1 
pieces of information. These are the past n values of the output: ylk ~ 1], y[k - 


2], ..., y[k—n], the past n values of the input: f[k—1], f[k—2], ..., f{k—n], and the 
present value of the input f{k]. If the input is causal, then fi-1] = f[-2]) =... = 
£[~n] = 0, and we need only n initial conditions y(~1], y{—2}, ..., y(—n]. This result 
allows us to compute iteratively or recursively the output y[0}, y[1], v[2], y [3], ..., 
and so on.t For instance, to find y[0] we set k = 0 in Eq. (9.2c). The left-hand 
side is y/0], and the right-hand side contains terms y{~1], y{—2], ..., y[—n], and 
the inputs f[0], ff), f#[-2], ..., f[—n]. Therefore, to begin with, we must know 
the n initial conditions y[— 1], y[-2], ... , y[~-n]. Knowing these conditions and the 
input f[k], we can iteratively find the response y(0], y[1], y[2], ..., and so on. The 


following examples demonstrate this procedure. This method basically reflects the 
manner in which a computer would solve a difference equation, given the input and 
initial conditions. 


{For this reason Eq. (9.2) is called a recursive difference equation. However in Eq. (9.2), if 
ao = Q1 = a2 = -= an1 = 0, then, according to Eq. (9.2c), determination of the present 


recursive system with a9 =a, =... = @n~1 = 0. Design of recursive and nonrecursive systems is 
discussed in Chapter 12. 
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Fig. 9.1 Iterative solution of a difference equation in Example 9.1. 


E] Example 9.1 
Solve iteratively 


ylk] — 0.5y[k — 1] = F(R] (9.3a) 
with initial condition y[—1] = 16 and causal input f{k] = k? (starting at k = 0). This 
equation can be expressed as 

ylk] = 0.5y[k — 1] + f[k] (9.3b) 


If we set k = 0 in this equation, we obtain 


y{0] =0.5y[—1] + f [0] 
=0.5(16) +0=8 
Now, setting k = 1 in Eq. (9.3b) and using the value y[0] = 8 (computed in the first step) 
and f{1] = (1)? = 1, we obtain 
s[i] = 0.5(8) + (1)? =5 
Next, setting k = 2 in Eq. (9.3b) and using the value y[1] = 5 (computed in the previous 
step) and f[2] = (2)?, we obtain 
y(2] = 0.5(5) + (2)? = 6.5 


Continuing in this way iteratively, we obtain 


y[3] = 0.5(6.5) + (3)? = 12.25 
y[4] = 0.5(12.25) + (4)? = 22.125 


The output y[k] is depicted in Fig. 9.1. W 


We now present one more example of iterative solution—this time for a second- 
order equation. Iterative method can be applied to a difference equation in delay 
or advance operator form. In Example 9.1 we considered the former. Let us now 
apply the iterative method to the advance operator form. 


a Example 9.2 
Solve iteratively 


ylk + 2] — yfk + 1] + 0.24y[k] = fik +2] - 2f[k + 1] (9.4) 


with initial conditions y[—1] = 2, y[-2] = 1 and a causal input f[k] = k (starting at 
k = 0). The system equation can be expressed as 
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ylk + 2] = ylk + 1] — 0.24y[k] + f[k + 2] — 2f[k + 1] (9.5) 


Setting k = —2 and then substituting y[—1] = 2, y[—2] = 1, [0] = f[-1] = 0 (recall that 
f[k] = k starting at k = 0), we obtain 


y[0] = 2 — 0.24(1) +0 — 0 = 1.76 


Setting k = —1 in Eq. (9.5) and then substituting y[0] = 1.76, y[-1] = 2, [1] = 1, f[0] = 0, 
we obtain 


y[1] = 1.76 — 0.24(2) + 1 — 0 = 2.28 


Setting k = 0 in Eq. (9.5) and then substituting y[0] = 1.76, y[1] = 2.28, f[2] = 2 and 
f[1] = 1 yields 


y[2] = 2.28 — 0.24(1.76) + 2 — 2(1) = 1.8576 


and soon. E 


Note carefully the iterative or recursive nature of the computations. From the 
n initial conditions (and input) we obtained y[0] first. Then, using this value of 
y[0] and the previous n — 1 initial conditions (along with the input), we found y[1]. 
Next, using y[0], y[1] along with the initial conditions and input, we obtained y[2], 
and so on. This method is general and can be applied to a difference equation of 
any order. The iterative procedure cannot be applied to continuous-time systems. 
It is interesting that the hardware realization of Eq. (9.3a) depicted in Fig. 8.17 
(with y = 0.5) generates the solution precisely in this (iterative) fashion. 


A Exercise E9.1 
Using the iterative method, find the first three terms of y|k] if 
yik + 1] — 2y[k] = ffk] 
The initial condition is y[—1] = 10 and the input f{k] = 2 starting at k = 0. 
Answer: y[0] = 20, y[1] = 42, and y[2] = 86. y 


© Computer Example C9.1 
Solve Example 9.2 using MATLAB. 


%(c91.m) 
Y=[1 2]; Y=Y’; 
k=-2:2; k=k’; 
f=(0 0 0)’; 
for m=1:length(k)-2 
y=Y(m+1)-0.24*Y(m)+£(m-+2)-2*f(m+1); 
Y=[Y3y]; 
F=m;f=f[f;F]; 
end 
stem(k,Y) 
[k Y] 
c91 
ans = 
-2.0000 1.0000 
-1.0000 2.0000 
0 1.7600 
1.0000 2.2800 
2.0000 0.8576 © 
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We shall see in the future that the solution of a difference equation obtained 
in this direct (iterative) way is useful in many situations. Despite the many uses 
of this method, a closed-form solution of a difference equation is far more useful 
in study of the system behavior and its dependence on the input and the various 
system parameters. For this reason we shall develop a systematic procedure to 
analyze discrete-time systems along lines similar to those used for continuous-time 
systems. 


Operational Notation 
In difference equations it is convenient to use operational notation similar to 
that used in differential equations for the sake of compactness. In continuous- 
time systems we used the operator D to denote the operation of differentiation. 
For discrete-time systems we shall use the operator E to denote the operation for 
advancing the sequence by one time unit. Thus 
Ef[k] = f[k +1] 
E?’ {k] = fik + 2} 


E” fik] = fik +n] (9.6) 


The first-order difference equation of the savings account problem was found 
to be [see Eq. (8.25b)} 


ylk + 1] — ay[k] = f[k + 1] (9.7) 
Using the operational notation, we can express this equation as 


Eylk] — ay[k] = E f [k] 
or 


(E — a)ylk] = E fk] (9.8) 
The second-order difference equation (8.26b) 
yik +2] + ylk +1] + seylk] = fik + 2] 
can be expressed in operational notation as 
(E? + 1E + 4) ylk] = E? Fk] 


A general nth-order difference Eq. (9.2a) can be expressed as 


(E” +an-1E°7! +--+ +a,E + ao)y[k] = 
(bnE” + ba_1 EB") +--+ +b, E + bo)f [k] (9.9a) 
or 
Q(E]y[k] = P[E}]f [k] (9.9b) 
where Q[E] and P[E] are nth-order polynomial operators 
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Q[E] = E” +an-1E" 14... +a, E + ao (9.10) 
P[E] = bn E” + bp 1B" 1 +... +b E + bo (9.11) 


Response of Linear Discrete-Time Systems 


Following the procedure used for continuous-time systems on p. 105 (footnote), 
we can show that Eq. (9.9) is a linear equation (with constant coefficients). A system 
described by such an equation is a linear time-invariant discrete-time (LTID) system. 
We can verify, as in the case of LTIC systems (see footnote on p. 105), that the 
general solution of Eq. (9.9) consists of zero-input and zero-state components. 


9.2 System response to Internal Conditions: The Zero-Input 
Response 


The zero-input response yolk] is the solution of Eq. (9.9) with f[k] = 0; that is, 


Q[E]yo[k] = 0 (9.12a) 

Or 
(B" + an 1B") +... +a1E +. a9)yo{k] = 0 (9.12b) 

or 
yolk +n] + an—iyolk +n- I +--+ aryo[k + 1] + aoyo[k] = 0 (9.12c) 


We can solve this equation systematically. But even a cursory examination of this 
equation points to its solution. This equation states that a linear combination 
of yo[k] and advanced yofk] is zero not for some values of k, but for all k. Such 
situation is possible if and only if yo [k] and advanced yo [k] have the same form. Only 
an exponential function y* has this property as the following equation indicates. 


Etm ee (9.13) 

This equation shows that the delayed y* is a constant times 7*. Therefore, the 
solution of Eq. (9.12) must be of the form 

yolk] = cy* (9.14) 


To determine c and y, we substitute this solution in Eq. (9.12). Equation (9.14) 
yields 


Eyo[k] = yolk + 1] = ey*t} 
BE? yo(k] = k +2] = cy*t? 
olk] = yolk + 2] = cy (9.15) 


E" yolk] = yolk +n] = ey**" 
Substitution of these results in Eq. (9.12b) yields 


ely” +an-17 7l +--+ aiy + ao)7* =0 (9.16) 
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For a nontrivial solution of this equation 


(1° tan- +--- +017 +49) =0 (9.17a) 
or 


Qh] =0 (9.17b) 


Our solution cy* [Eq. (9.14)] is correct, provided that y satisfies Eq. (9.17). Now, 
Q[y] is an nth-order polynomial and can be expressed in the factorized form (as- 
suming all distinct roots): : 


(y — n)(y = 72): (y-n) = 0 (9.17c) 
Clearly, y has n solutions y1, Yo, -- - 1 Yn and, therefore, Eq. (9.12) also has n solutions 
ciyf, cork, tee en. In such a case we have shown (see footnote on p. 106) that 


the general solution is a linear combination of the n solutions. Thus 


yolk] = eye + cork +--+ cny (9.18) 


where 71, Y2, +, Yn are the roots of Eq. (9.17) and c1, ¢€2,...,Cn are arbitrary con- 
stants determined from n auxiliary conditions, generally given in the form of initial 
conditions. The polynomial Q[y] is called the characteristic polynomial of the 
system, and 


Qh] =0 (9.19) 
is the characteristic equation of the system. Moreover, 71, Y2, ***, Yn, the roots 
of the characteristic equation, are called characteristic roots or characteristic 
values (also eigenvalues) of the system. The exponentials y¥(i = 1,2,... n) are 


the characteristic modes or natural modes of the system. A characteristic 
mode corresponds to each characteristic root of the system, and the zero-input 
response is a linear combination of the characteristic modes of the system. 


Repeated Roots 


In the discussion so far we have assumed the system to have n distinct character- 
istic roots y1, Y2,..., Yn with corresponding characteristic modes ok 7k, rou Wk. If 
two or more roots coincide (repeated roots), the form of characteristic modes is mod- 
ified. Direct substitution shows that if a root y repeats r times (root of multiplicity 
r), the characteristic modes corresponding to this root are y*, ky*, k? Re ce kr-lyk, 
Thus, if the characteristic equation of a system is 


Qld] = (7 = 11)" (Y — Way — Yr42)°- (1 Yn) (9.20) 


the zero-input response of the system is 


yolk] = (c1 +.cok +e3k? +--+ ek’ 1) 4% Se oo + Creo Its. +-+ cny (9.21) 


Complex Roots 


As in the case of continuous-time systems, the complex roots of a discrete-time 
system must occur in pairs of conjugates so that the system equation coefficients 
are real. Complex roots can be treated exactly as we would treat real roots. How- 
ever, just as in the case of continuous-time systems, we can eliminate dealing with 
complex numbers by using the real form of the solution. 
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First we express the complex conjugate roots y and y* in polar form. If ly] is 
the magnitude and £ is the angle of y, then 
y=|e?? and -y* = [ye 98 


The zero-input response is given by 


volk] =cry* + co(y*)* 
=c1}y|*e* + caly|ke~F0H 


For a real system, cı and c must be conjugates so that yo[k] is a real function of 
k. Let 


Then c = Set? and c= $e 98 
yolk] =ly|* [eseo R giek 


=c|y|" cos (Bk + 0) (9.22) 
where c and 0 are arbitrary constants determined from the auxiliary conditions. 


This is the solution in real form, which avoids dealing with complex numbers. 


m Example 9.3 
(a) For an LTID system described by the difference equation 


ylk + 2] — 0.6y[k + 1] — 0.16yfk] = 5f[k + 2 (9.23a) 


find the total response if the initial conditions are y[-1} = 0 and y[{—2] = 25 and if the 
input f[k] = 4-*Fulk). In this example we shall determine the zero-input component yofk] 


only. The zero-state component is determined later in Example 9.7. 
The system equation in operational notation is 
(E? — 0.6E — 0.16)y[k] = 5E? f [k] (9.23b) 
The characteristic polynomial is 
7” — 0.6y — 0.16 = (y + 0.2)(y — 0.8) 


The characteristic equation is 


(y + 0.2)(y - 0.8) = 0 (9.24) 

The characteristic roots are yı = —0.2 and 2 = 0.8. The zero-input response is 
yo[k] = c1(—0.2)* + co(0.8)* (9.25) 
To determine arbitrary constants cı and c2, we set k = —1 and —2 in Eq. (9.25), then 


substitute yo[—1] = 0 and yo[—2] = 28 to obtaint 


0 = — 5c1 + Bee a=} 

25 25 25 i 4 

T —29c1 + Tyce c2 =F 

Therefore E e 3 
yolk] = 3(—0.2)* + 4(0.8)* (9.26) 


{The initial conditions y[—1] and y(—2] are the conditions given on the total response. But because 
the input does not start until k = 0, the zero-state response is zero for k < 0. Hence, at k = —1 
and —2 the total response consists of only the zero-input component, so that y[—1] = yo{—1] and 
yl—2] = yo[—2]. 
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The reader can verify this solution by computing the first few terms using the iterative 
method (see Examples 9.1 and 9.2). 


(b) A similar procedure may be followed for repeated roots. For instance, for a 
system specified by the equation 
(E? + 6E + 9)y[k] = (2E? + 6E) f[k] 


determine yo[k], the zero-input component of the response if the initial conditions are 
vol—1] = — and yof-2] = —2. 

The characteristic polynomial is y? + 6y +9 = (y + 3)?, and we have a repeated 
characteristic root at y = --3. The characteristic modes are (—3)* and k(—3)*. Hence, 
the zero-input response is 


volk] = (c1 + cok)(—3)* 


We can determine the arbitrary constants c; and c2 from the initial conditions following 
the procedure in part (a). It is left as an exercise for the reader to show that cı = 4 and 
c2 = 3 so that 


yolk] = (4 + 3k)(—3)* 


(c) For the case of complex roots, let us find the zero-input response of an LTID 
system described by the equation 


(E? — 1.56E + 0.81)y[k] = (E + 3)f[k] 


when the initial conditions are yof—1] = 2 and yo[—2] = 1. 
The characteristic polynomial is (7?-1.567+0.81) = (y—0.78— 0.45) (y—0.78+ 70.45). 
The characteristic roots are 0.78 + j0.45; that is, 0.9e49%, Thus, |y| = 0.9 and 8 = 7/6, 
and the zero-input response, according to Eq. (9.22), is given by 
yolk] = c(0.9)* cos (Zk + 0) 


To determine the arbitrary constants c and 6, we set k = —1 and —2 in this equation and 
substituting the initial conditions yo[—1] = 2, yo[—2] = 1, we obtain 


n c 1 v3. 
1 =——~. cos (-3 +9) = O81 [pow 0+ Fain | 


or 
¥3 ccos 6+ j:csin 6 =2 
pep ccos 0 + PS csin 6 = 1 
These are two simultaneous equations in two unknowns ccos 0 and csin 8. Solution of 
these equations yields 


ccos 6 =2.308 
csin 0 = — 0.397 


Dividing csin 0 by ccos 8 yields 
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—0.397 _ —0.172 


Wl og T 


6 = tan” '(—0.172) = —0.17 rad. 


Substituting @ = —0.17 radian in ccos 9 = 2.308 yields c = 2.34 and 


volk] = 2.34(0.9)* cos ($k — 0.17) k20 


Observe that here we have used radian unit for both 8 and @. We also could have used 
the degree unit, although it is not recommended. The important consideration is to be 
consistent and to use the same units for both 8 and 6. E 


A Exercise E9.2 
Find and sketch the zero-input response for the systems described by the following equations: 
(a) yik + 1] — 0.8y[k] = 3f[k +1] (b) y[A+ 1) + 0.8y[k] = 3f[k + J. 
In each case the initial condition is y[—1] = 10. Verify the solutions by computing the first 
three terms using the iterative method. 


Answer: (a) 8(0.8)* (b)—8(-0.8)§. y 


A Exercise E9.3 
Find the zero-input response of a system described by the equation 


ylk] + 0.3y[k — 1] — 0.1y[k — 2] = f[k] + 2fİk — 1] 
The initial conditions are yo[—1] = 1 and yo[—2] = 33. Verify the solution by computing the 


first three terms iteratively. 
Answer: yo[k] = (0.2)* + 2(-0.5)* v 


A Exercise E9.4 
Find the zero-input response of a system described by the equation 


vik] + 4y[k — 2] = 2f[k} 
The initial conditions are yo[—1] = -37 and yo[~—2] = We Verify the solution by computing 
the first three terms iteratively. 


Answer: yo[k] = (2)* cos (Zk — a) y 


© Computer Example C9.2 
Find and sketch the zero-input response for the system described by 


(E? — 1.56E + 0.81)y[k] = (E + 3)f[k] 


using the initial conditions y[-1]=2, and y[-2]=1. 


y=[1 2]; y=y’s 

k=-2:16; k=k’; 

for m=1:length(k)-2 
Y=1.56*y(m+1)-0.81*y(m); 
Y2i=[Yzi;Y]; 

end 

stem(k,Yzi) O 
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9.3 The Unit Impulse Response h[k] 


Consider an nth-order system specified by the equation 


(E” + an1 E”! ++--+a,E +a9)y[k] = 
(bn EB” + bn-pE" | +--+ +b, E + bo) f[k] (9.272) 


or 
Q[E]y[k] = P[E]f [k] (9.27b) 


The unit impulse response A[k] is the solution of this equation for the input 6[k] 
with all the initial conditions zero; that is, 


Q{E|h[k] = P[E]6[k] (9.28) 
subject to initial conditions 
h[-1] = h[-2] =--- = A[-n] =0 (9.29) 


Equation (9.28) can be solved to determine A[k] iteratively or in a closed form. The 
following example demonstrates the iterative solution. 


W Example 9.4: Iterative Determination of h[{k] 
Find A[k], the unit impulse response of a system described by the equation 


ylk] — 0.6y[k — 1] — 0.16y[& — 2] = 5f{k] (9.30) 


To determine the unit impulse response, we must let the input f{k] = [k] and the 
output y[k] = h[k] in the above equation. The resulting equation is 


h[k] — 0.6h[& — 1] — 0.16h{k — 2] = 5ôfk] (9.31) 


subject to zero initial state; that is, h[-1] = h[-2] = 0. 
Setting k = 0 in this equation yields 


h[0] — 0.6(0) — 0.16(0) = 5(1) => h[0] = 5 


Next, setting k = 1 in Eq. (9.31) and using A[0] = 5, we obtain 


h[1] — 0.6(5) — 0.16(0) = 5(0) => A] =3 E 


Continuing this way, we can determine any number of terms of A[k]. Unfortu- 
nately, such a solution does not yield a closed-form expression for h[k]. Nevertheless, 
determining a few values of h[k] can be useful in determining the closed-form solu- 
tion, as the following development shows. 


The Closed-Form Solution of h[k] 

Recall that [k] is the system response to input 6[k], which is zero for k > 0. 
We know that when the input is zero, only the characteristic modes can be sustained 
by the system. Therefore, h[k] must be made up of characteristic modes for k > 0. 
At k = 0, it may have some nonzero value Ag, so that h[k] can be expressed as 


h[k] = Aoô[k] + yn[k] (9.32) 
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where, yn[k] is a linear combination of the characteristic modes. In Appendix 9.1 
we show that 


Ag = — (9.33) 


ag 


Moreover, because h[k] is causal, we must multiply yn[k] by ufk]. Therefore,t 


hjk] = ah] + vnlkjufk] (9.34) 


The n unknown coefficients in y,[k] (on the right-hand side) can be determined 
from a knowledge of n values of h[k]. Fortunately, it is a straightforward task to 
determine values of h[k] iteratively, as demonstrated in Example 9.4. We compute 
n values h{0], A[1}, h[2],--- , h[n — 1] iteratively. Now, setting k =0,1,2,---,n—1 
in Eq. (9.34), we can determine the n unknowns in Yn[k]. This point will become 
clear in the following example. 


E Example 9.5 
Determine the unit impulse response h[k] for a system in Example 9.4 specified by 
the equation 


ylk] — 0.6y[k — 1] — 0.16y[k — 2] = 5f [k] 
This equation can be expressed in the advance operator form as 
ylk + 2] — 0.6y[k + 1] ~ 0.16y[k] = 5f[k + 2] (9.35) 
or 
(E? — 0.6E ~ 0.16)y[k] = 5E” f[k] (9.36) 
The characteristic polynomial is 
Y? ~ 0.67 — 0.16 = (y + 0.2)(y — 0.8) 
The characteristic modes are (—0.2)* and (0.8)*. Therefore 
yn[k] = e1(—0.2)* + c2(0.8)* (9.37) 
Also, from Eq. (9.36), we have ao = —0.16 and bo = 0. Therefore, according to Eq. (9.34) 
hik] = [c1(—0.2)* + c2(0.8)*]ufk] (9.38) 
To determine c; and c2, we need to find two values of h[k] iteratively. This step is already 
taken in Example 9.4, where we determined that A[0] = 5 and R[1] = 3. Now, setting 
k = 0 and 1 in Eq. (9.38) and using the fact that h{0] = 5 and A[1] = 3, we obtain 
5=ci+c2 c& =l 
3 = —0.2c1 + 0.8c2 


tWe showed that h{k] consists of characteristic modes only for k > 0. Hence, the characteristic 
mòde terms in h[k] start at k = 1. To reflect this behavior, they should be expressed in the form 
yjulk — 1]. But because ujk — 1] = ufk] — 6[k], Asyulk =1]= Ajy¥u[k] — Aj6[k], and hfk] can 


be expressed in terms of exponentials YFulk] (which start at k = 0), plus an impulse at k = 0. 
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Therefore 
hfk] = [(—0.2)" + 4(0.8)*] u[k] (9.39) 


© Computer Example C9.3 

Solve Example 9.5 using Matlab. 

There are several ways of finding impulse response by Matlab. In this method, we 
specify the system and the input by a, b, and f vectors. The response is plotted for 20 
points. This program can be used to find the discrete-time system response to any input. 

N=20; 

b=[5 0 0); 

a=[1 -0.6 -0.16]; 

f=[1,zeros(1,N-1)}; 

y=filter(b,a,f); 

k=0:1:N-1; 

stem(k,y) 

xlabel(’k’);ylabel(’h[k]’); © 


Comment 

Although determination of the impulse response h[k] using the procedure in this 
section is relatively simple, in Chapter 11 we shall discuss another, much simpler, 
method of z-transform. 

In the present method, when ag = 0, Ao cannot be determined from Eq. (9.33). 
It is shown in Appendix 9.1 that in such a case the impulse response contains an 
additional impulse at k = 1, and h[k] can be expressed as 


h[k] = Aod{k] + A16[k — 1] + ynlk]u[k] 


Now h[k] contains n + 2 unknowns (Ag, Ai, and n coefficients of yn{k]), which can 
be determined from n + 2 values of h[{k] obtained iteratively. 
A Exercise E9.5 
Find h{k], the unit impulse response of the LTID systems specified by the following equations: 
(a) ylk + 2] — 5y[k + 1] + 6y[k] = 8f[k + 1] — 19f Ík) 
(b) ylk + 2] — 4y[k + 1] + 4y[k] = 2f[k + 2] — 2f[k + 1] 
Answers: 
(a) hfk] = —725[k} + (3 (2)* + 8(3)*]ufa] 
(b) hfk] = (2 + k)2* ulk] 


9.4 System Response to External Input: The Zero-State 
Response 


The zero-state response y[k] is the system response to an input f [k] when the 
system is in zero state. In this section we shall assume that systems are in zero 
state unless mentioned otherwise, so that the zero-state response will be the total 
response of the system. Here we follow the procedure parallel to that used in the 
continuous-time case by expressing an arbitrary input f(k] as a sum of impulse 
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(a) 


(b) 
fI-1Jò[k+1] 
(c) 
: ; ke 
f[0J8[k] 
(d) 
FUSEE-1] 
(e) 
1 k— 
f[2}8[k-2] 
® 
2 ka 


Fig. 9.2 Representation of an arbitrary signal f[k] in terms of impulse components. 


components. Figure 9.2 shows how a signal f [k] in Fig. 9.2a can be expressed as 
a sum of impulse components such as those depicted in Figs. 9.2 b, c, d, e, and f. 
The component of f[k] at k = m is f[m]é[k — m], and f [k] is the sum of all these 
components summed from m = —oo to oo. Therefore 


F[k] = F[O]5[k] + F[L]6[e — 1] + F(2}6[k — 2} +--- 
+ f[-1é6[k + 1] + f[-2]6[k + 2) +--- 


= SO fim]êfk- m] (9.40) 


m=—00 
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If we knew the system response to impulse 4[k], the system response to any arbi- 
trary input could be obtained by summing the system response to various impulse 
components. Let h[k] be the system response to impulse input 6[k]. We shall use 
the notation 


fik] => yik] 
to indicate the input and the corresponding response of the system. Thus, if 
5[k] => hjk] 


then because of time invariance 
6[k — m] = h{k — m] 
and because of linearity 
flm]6[k ~ m] = f[mJh[k — m] 
and again because of linearity 


S flm|s[k—m] => Ý ffm]rle - m] 


m=—00 m=—oo 
fik] vik] 


The left-hand side is f[(k] [see Eq. (9.40)], and the right-hand side is the system 
response y[k] to input f[k]. Therefore 


vlk] = $. fim]ajk- m] (9.41) 


m=—00 


The summation on the right-hand side is known as the convolution sum of fik] 
and h[k], and is represented symbolically by f [k] » h[k] 


fik] + alk] = X fimlh[k - m] (9.42) 


m=—0co 


Properties of the Convolution Sum 


The structure of the convolution sum is similar to that of the convolution 
integral. Moreover, the properties of the convolution sum are similar to those of 
the convolution integral. We shall enumerate these properties here without proof. 
The proofs are similar to those for the convolution integral and may be derived by 
the reader. 


1. The Commutative Property 


falk] * folk] = falk] * fıfk] (9.43) 
2. The Distributive Property 


Filk] * (folk) + falk]) = fale] * folk] + Falk] « falk] (9.44) 
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3. The Associative Property 


Falk] * (falk) * fa[k]) = (F1[k] * falk]) * falk] (9.45) 
4. The Shifting Property 
If 
Silk] * folk] = c[k] 
then+ 


Silk — m] * folk — n] = c[k -m — n] (9.46) 


5. The Convolution with an Impulse 


f{k] + 6[k] = f{k] (9.47) 
6. The Width Property 


If fi[k] and fo[k] have lengths of m and n elements respectively, then the 
length of c[k] is m +n — 1 elements.t The width property may appear to be 
violated in some special cases as explained on p. 136. 


Causality and Zero-State Response 

In deriving Eq. (9.41), we assumed the system to be linear and time-invariant. 
There were no other restrictions on either the input signal or the system. In practice, 
almost all of the input signals are causal, and a majority of the systems are also 
causal. These restrictions further simplify the limits of the sum in Eq. (9.41). If 
the input fk] is causal, f[m] = 0 for m < 0. Similarly, if the system is causal (that 
is, if h[k] is causal), then h[z] = 0 for negative z, so that h{k — m] = 0 when m > k. 
Therefore, if f [k] and h{k] are both causal, the product f[m]h[k —m] = 0 for m < 0 
and for m > k, and it is nonzero only for the range 0 < m < k. Therefore, Eq. 
(9.41) in this case reduces to 


k 
vlk] = $. flmjafe — m] (9.48) 
m=0 


We shall evaluate the convolution sum first by an analytical method and later 
with graphical aid. 


a Example 9.6 
Determine c[k] = f[k] » g[k] for 


fik] = (0.8)*ufk] and gk] = (0.3)* uk] (9.49) 
We have 
elk] = SF lmjg[& — m] 
Note that "=o 
fim} = (0.8)"u[m] and g|k — m] = (0.3)*-" uk — m] (9.50) 


Both f[k] and g[k] are causal. Therefore, [see Eq. (9.48)] 


TThe width of a signal is one less than the number of its elements (length). For instance, the 
signal in Fig. 9.3h has 6 elements, but has a width of only 5. Thus, if fifk] and f2[k] have widths 
of W, and W2, respectively, then the width of c[k] is Wy + W2. 


9.4 System response to External Input: The Zero-State Response 589 


k 
cik] = > fimo — m] 


m=0 


k 
= X (0.8)"ufm] (0.3)*-"ulk — m] (9.51) 


m=0 


In the above summation, m lies between 0 and k (0 < m < k). Therefore, if k > 0, then 
both m and k — m > 0, so that ulm] = u[k — m) = 1. If k < 0, m is negative because m 
lies between 0 and k, and u[m] = 0. Therefore, Eq. (9.51) becomes 


k 
fk] = S>(0.8)"(0.3)"™ k20 


m=0 


=0 k<0 


c[k] = (0.3)! 3 (55) uf] 


This is a geometric progression with common ratio (0.8/0.3). From Sec. B.7-4 we have 


and 


g (0.8)*+1 pe (0.3)**? 


clk] =(0.3) 0.308 0.3) vl 
=2 {(0.8)*4? — (0.3)**7] ufk] (9.52) 
A Exercise E9.6 | 


Show that (0.8)*u{k] * u[k] = 5[1 — (0.8)**4]ulk] 7 


Convolution Sum from a Table 

Just as in the continuous-time case, we have prepared a table of convolution 
sums (Table 9.1) from which convolution sums may be determined directly for a 
variety of signal pairs. For example, the convolution in Example 9.6 can be read 
directly from this table (Pair 4) as 


k+1 _ k+1 
(0.8)"u[k] + (0.3)*ufe] = a 0.8 — <n 


We shall demonstrate the use of the convolution table in the following example. 


u[k] = 2{(0.8)*** — (0.3)**"Ju[a] 


a Example 9.7 
Find the (zero-state) response y[k] of an LTID system described by the equation 


ylk + 2] ~ 0.6y[k + 1] — 0.16y{k] = 5f[k + 2] 


if the input f[k] = 4—*u[&]. 
The unit impulse response of this system is obtained in Example 9.5. 


hik] = {(—0.2)* + 4(0.8)"]u[k] (9.53) 
Therefore 


ylk] =F [k] * h[k] 
=(4) *u[k] + [(—0.2)"u[k] + 4(0.8)"u[k]] 
=(4)~*ufk] + (—0.2)*u[k] + (4) u[k] * 4(0.8)"u[k] (9.54) 
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TABLE 9.1: Convolution Sums 


= folk] * filk] 


Silk] * folk] 


falk] 


ilk] 


No. 


fik- j] 


Fk] 


ôlk — j] 


u[k] 


y*ulk] 


2 


{k + 1)ufk] 


ulk] 


ulk] 


| ulk] yı #72 


= yt} 
v1 — Y2 


k+1 
1 


Bulk] 


yřu[k] 


4 


2l > Ial 


yžuļ-(k + 1)] 


2 
Va V1: 


yřu[k] + 


yı 


72-91 


yžuļ-(k + 1)] 


yřujk] 


5 


yyufk] 


kyfulk] 


k(k — 1)(k + 1)ulk] 


1 
6 


ku[k] 


ku[k] 


7 


ul] (k + 1)y*ufk] 


Fulk] 


8 


| ts 
[laal**? cos[A(k + 1) + 6 — g} — 78+? cos(o — ¢)] ufk] 


yO- 1) + k(1 ~ 7) 
(1-7)? 


| 


ku[k] 


y*ulk] 


9 


2 real 


tri" cos(Bk + 6)u[k] yEulk] 


10 


2 
R= (Ia /? +93 — 2Iy1}72 cos £] ae 


(yl sin 8) ] 


(ly1] cos 8 — y2) 


¢ = tan”! [ 
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Note that 
(4)~*ule] = (3)* ula] = (0.25)* fa] 
Therefore 


ylk] = (0.25)*u[k] + (—0.2)*ufk] + 4(0.25)*ufk] + (0.8)*ufh] 


We use Pair 4 (Table 9.1) to find the above convolution sums. 


_ | (0.25)**! — (~0,2)4+2 
vik] | 0.25 — (-0.2) 


= (2.22 [(0.25)**? — (—0.2)***] — 7.27 [(0.25)*#? — (0.8)**"]) ufk] 
[—5.05(0.25)**1 — 2.29(-0.2)*+4 + 7.27(0.8)**"] ufk] 


(0.25)** — (9.8)k+1 
025 08 | ulk} 


tl 


Recognizing that 
k 
at? = y(7)" 


We can express y[k] as 


ylk] = [~1.26(0.25)* + 0.444(—0.2)* + 5.81(0.8)*] u[k] 
= [-1.26(4)-* + 0.444(-0.2)* + 5.81(0.8)"] ufk] (9.55) 


A Exercise E9.7 
Show that (0.8)*++u{k] « ufk] = 4[1 — 0.8(0.8)*]u[k] 
Use convolution table. Recognize that (0.8)*+! = 0.8(0.8) y 


A Exercise E9.8 
Show that k3~*ulk] + (0.2)*u{k] = 48[(0.2)* — (1 — 2k)3~*)ulk] 
Hint: Use convolution table. Recognize that 3-* = ( 5)" Vv 


A Exercise E9.9 
Using convolution table, show that e~*u[k] + 2-*ufk] = g2zle“* — £2-*}ufk] 
Hint: e~* = (1)* and 2-* =(0.5)* y 


© Computer Example C9.4 
Find and sketch the zero-state response for the system described by 


(E? + 6E + 9)y[k] = (2E? + 6E) fk] 


for the input f[k] = 4*u{k]. 


k=0:11; 

b=[2 6 0}; 

a=[1 6 9]; 

f=4.° (k); 

y=filter(b,a,f); 

stem(k,y) 
xlabel(’k’);ylabel(’y[k}’);_ © 
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9.4-1 Graphical Procedure for the Convolution Sum fik] g [k] 


The steps in evaluating the convolution sum are parallel to those followed in LE S (0.8)* 1g (0.3)* 
evaluating the convolution integral. The convolution sum of causal signals f {k] and S i 
g [k] is given by 


k 
c[k] = > f[m]g[k — m] 
m=0 


We first plot f[m] and g[k — m] as functions of m (not k), because the summation is 
over m. Functions f{m] and g{m] are the same as f{k] and g[k], plotted respectively 
as functions of m (see Fig. 9.3). The convolution operation can be performed as 
follows: 

1. Invert g[m] about the vertical axis (m = 0) to obtain g[—m] (Fig. 9.3d). Figure 
9.3e shows both f[m] and g[—m]. 

2. Time shift g[—m] by k units to obtain g[k — m]. For k > 0, the shift is to the 
right (delay); for k < 0 , the shift is to the left (advance). Figures 9.3f and 9.3g 
show g[k — m] for k > 0 and for k < 0, respectively. 

3. Next we multiply f[m] and g[k — m] and add all the products to obtain cfk]. 
The procedure is repeated for each value of k over the range —co to oo. 


We shall demonstrate by an example the graphical procedure for finding the 
convolution sum. Although both the functions in this example are causal, the 
procedure is applicable to general case. 


E Example 9.8 


e) 
Find i 


c[k] = f[k] + g[k] 


where f[k] and g[k] are depicted in Figs. 9.3a and 9.3b, respectively. 
We are given 
f[k] = (0.8)* and gfk] = (0.3)* 
Therefore 
fim] = (0.8)™ and g[k ~ m] = (0.3)*-™ 


Figure 9.3f shows the general situation for k > 0. The two functions f [m] and gfk — m] 
overlap over the interval 0 < m < k. Therefore 


efk] = $ fim]øfk — m] 


m=0 


k 
= $ (0.8)"(0.3)*-™ 
m=0 


=(0.3)* 5 (ae 


=2 [(0.8)**7 — (0.3)"t?}] k20 (see Sec. B.7-4) 


For k < 0, there is no overlap between f[m] and g[k — m], as shown in Fig. 9.3g so that 


ck] =0 k<0 Fig. 9.3 Graphical understanding of convolution of f[k] and g|k] for Example 9.7. 
and 


c[k] = 2 [(0.8)**? — (0.3)** | ufk] (9.56) 
which agrees with the earlier result in Eq. (9.52). $ 
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A Exercise E9.10 
Find (0.8)*u(k] * u[k] graphically and sketch the result. 


Answer: 5(1 — (0.8)**1)u[k] y 


An Alternative Form of Graphical Procedure: The Sliding Tape Method 


This algorithm is convenient when the sequences f [k] and g{k] are short or when 
they are available only in graphical form. The algorithm is basically the same as the 
graphical procedure in Fig. 9.3. The only difference is that instead of presenting the 
data as graphical plots, we display it as a sequence of numbers on tapes. Otherwise 
the procedure is the same, as will become clear in the following example. 


| Example 9.9 

Using the sliding tape method, convolve the two sequences fk] and g[k] depicted in 
Fig. 9.4a and 9.4b, respectively. In this procedure we write the sequences f [k] and g{k] in 
the slots of two tapes: f tape and g tape (Fig. 9.4c). Now leave the f tape stationary (to 
correspond to f[m]). The g[—m] tape is obtained by time inverting the g[m] tape about 
the origin (k = 0) so that the slots corresponding to f[0] and g[0] remain aligned (Fig. 
9.4d). We now shift the inverted tape by k slots, multiply values on two tapes in adjacent 
slots, and add all the products to find c[k]. Figures 9.4d, e, f, g, h, i, and j show the cases 
for k = 0,1,2,3,4,5, and 6, respectively. For the case of k = 0, for example (Fig. 9.4d) 


clo] = 0x 1=0 
For k = 1 (Fig. 9.4e) 
cf] = (Ox 1)+(1x1)=1 
Similarly, 


c[2) =(0 x 1) + (1x 1I)+(2x 1) =3 

e[3] =(0 x 1) + (1 x 1)+ (2x 1+ (8x1) =6 

cf4] =(0 x 1) + (1 x 1) + (2x 1)+ (3x 1)+(4x1)=10 

c[5] =(0 x 1) + (1 x 1) + (2 x 1) + (3 x 1) + (4x 1)+ (5x 1) = 15 
e[6] =(0 x 1) + (1 x 1) + (2 x 1) + (3 x 1) + (4x 1)+ (5 x 1) = 15 


Figure 9.4j shows that c[k] = 15 for k > 5. Moreover, the two tapes are nonoverlap- 
ping for k < 0, so that c[k] = 0 for k < 0. Figure 9.4k shows the plot of c[k]. E 


© Computer Example C9.5 
Using Matlab, find the convolution of f[k] and g[k] depicted in Fig. 9.5. 


f=[0 1 2 3 2 1]; 
g=(111111); 
k=0:1:length(f)+length(g)-2; 
c=conv(f,g); 

stem(k,c) © 


An Array Form of Graphical Procedure 

The convolution sum can also be obtained from the array formed by sequences 
Jk] and g[k]. This procedure, although convenient from a computational viewpoint, 
fails to give proper understanding of the convolution mechanism. The procedure is 
explained in Prob. 9.4-16. 
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fik] 
{a) 
* 
234567 k= 
m=0 
4 
fim) 
e gl-m1lolil2l3lals]  cto=0 
ee zanni 


(d) 


c[l)=1 
rotate the g-tape about the 
verticle axis as showen in (d) 


c[2]=3 


c[3] =6 


of1}2}3}4]5] — lél=15 
coe HAMA LPL] LA k= 6 


Fig. 9.4 Sliding tape algorithm for discrete-time convolution. 


k) 
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(a) (b) 


(c) 


1234567891011 kk 
Fig. 9.5 Signals for Exercise E9.11. 


A Exercise E9.11 


Using the graphical procedure of Example 9.9 (sliding-tape technique), show that f[k]*9[k] = 
c[k] in Fig. 9.5. Verify the width property of convolution. y 


9.4-2 A Very Special Function For LTID Systems: The Everlasting 
Exponential z* 


In Sec. 2.4-3, we showed that there exists one signal for which the response 
of an LTIC system is the same as the input within a multiplicative constant. The 
response of an LTIC system to an everlasting exponential input e* is H (s)e%, where 
H(s) is the system transfer function. We now show that for an LTID system, the 
same role is played by an everlasting exponential z*. The system response y[k] in 
this case is given by 


y{k] = hjk] * 2* 


o0 


= D h[m]z*-™ 


m=- 
oo 
=t Ý hm] 
m=—oo 


For causal h{k], the limits on the sum on the right-hand side would range from 0 to 
oo. In any case, this sum is a function of z. Let us denote it by H [z]. Thus,} 


k] = H[z]z* a 
where ie A Coe 
H{z] = D h[m]z7™ (9.57b) 


ee ee ee 
T This result is valid only for the values of z for which the > aes h[m]z—™ exists (or converges). 
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Note that Hz] is a constant for a given z. Thus, the input and the output are the 
same (within a multiplicative constant) for the everlasting exponential input z*. 

H[z], which is called the transfer function of the system, is a function of the 
complex variable z. We can define the transfer function H [z] of an LTID system 
from Eq. (9.57a) as 


output signal 


H[z] = ~ - 
input signal 


(9.58) 


Input=everlasting exponential z* 


A Exercise E9.12 
Show that the transfer function of the digital differentiator in Example 8.7 (big shaded block 
in Fig. 8.20b) is given by H[z] = 44. y 


9.4-3 Total Response 


The total response of an LTID system can be expressed as a sum of the zero- 
input and zero-state components: 


Total response = > cjyf + = f{k] * A[k] 
= Nea a— 
7 Zero-state component 
Zero-input component 


In this expression, the zero-input component should be appropriately modified for 
the case of repeated roots. We have developed procedures to determine these two 
components. From the system equation we find the characteristic roots and charac- 
teristic modes. The zero-input response is a linear combination of the characteristic 
modes. From the system equation we also determine h[k}, the impulse response, 
as discussed in Sec. 9.3. Knowing h[k] and the input f[k], we find the zero-state 
response as the convolution of f[k] and h{k]. The arbitrary constants c1,c2,...,¢n 
in the zero-input response are determined from the n auxiliary conditions. For the 
system described by the equation 


ylk + 2] — 0.6y[k + 1] — 0.16y[k] = 5f[k + 2] 


with initial conditions y[—1] = 0,y[-2] = % and input f[k] = (4)~*u[k], we have 
determined the two components of the response in Examples 9.3a and 9.7 respec- 
tively. From the results in these examples, the total response for k > 0 is 


Total response = 0.2(—0.2)* + 0.8(0.8)* —1.26(4)—* + 0.444(—0.2)* + 5.81(0.8)* 
rr re” 


Zero-input component Zero-state component 


(9.59) 


Natural and Forced Response 


The characteristic modes of this system are (—0.2)* and (0.8)* . The zero-input 
component is made up of characteristic modes exclusively as expected, but the char- 
acteristic modes also appear in the zero-state response. When all the characteristic 
mode terms in the total response are lumped together, the resulting component is 
the natural response. The remaining part of the total response that is made up of 
noncharacteristic modes is the forced response. For the present case, Eq. (9.59) 
yields 
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‘Total response = 0.644(—0.2)* + 6.61(0.8)* — 1.26(4)~* k>0 (9.60) 
i! ee —’ 


Natural response Forced response 


9.5 Classical solution of Linear Difference Equations 


As in the case of LTIC systems, we can analyze LTID systems by using the 
classical method, where the response is obtained as a sum of natural and forced 
components of the response. 


Finding Natural and Forced Response 

As explained earlier, the natural response of a system consists of all the charac- 
teristic mode terms in the response. The remaining noncharacteristic mode terms 
form the forced response. If yn[k] and yg{k] denote the natural and the forced 
response respectively, then the total response is given by 


Total response = ynlk] + yelk] (9.61) 
anger ages) 


modes nonmodes 


Because the total response yn[k] + y¢{k] is a solution of the system equation (9.9), 
we have 


QIE] (ynlk] + yelk]) = PLE] S[k] (9.62) 
But since y,,[k] is made up of characteristic modes, 
Q[E]yn[k] = 0 (9.63) 
Substitution of this equation in Eq. (9.62) yields 
Q[E]yglk] = P[E]f [k] (9.64) 


The natural response is a linear combination of characteristic modes. The arbitrary 
constants (multipliers) are determined from suitable auxiliary conditions usually 
given as y(0],y[1],...,y[n — 1]. We now turn our attention to the forced response. 


Forced Response 


We have shown that the forced response yolk] satisfies the system Equation 
(9.64) 


Q[E]yalk] = P[E]f [k] 


By definition, the forced response contains only nonmode terms. To determine 
the forced response, we shall use a method of undetermined coefficients, the same 
method used for the continuous-time system. However, rather than retracing all 
the steps of the continuous-time system, we shall present a table (Table 9.2) listing 
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the inputs and the corresponding forms of forced function with undetermined co- 
efficients. These coefficients can be determined by substituting yg[k] in Eq. (9.64) 
and equating the coefficients of similar terms. 


Table 9.2 


Input f {k] Forced Response y¢|k] 
rE rp A#yi (i=l, 2,-+-,n) crf 
2. rE r= ckr* 


3. cos (Bk +8) ccos (Bk + ¢) 


m m : 
4. (3: ot rk (È sa) rk 
i=0 i=0 


Note: By definition, yg[k] cannot have any characteristic mode terms. If any terms 
shown in the right-hand column for the forced response should also be a characteristic 
mode of the system, the correct form of the forced response must be modified to k*yg[k], 
where i is the smallest integer that will prevent k*yg[k] from having a characteristic mode 
term. For example, when the input is r*, the forced response in the right-hand column is 
of the form cr. But if r* happens to be a natural mode of the system, the correct form 
of the forced response is ckr*(see Pair 2). 


a Example 9.10 
Solve 
(E? — 5E + 6)y{k] = (E — 5) f[k] (9.65) 


if the input f[k] = (3k + 5)u[k] and the auxiliary conditions are y[0] = 4, y{1] = 13. 
The characteristic equation is 
P ~5y+6 = (y-2)(y- 3) =0 
Therefore, the natural response is 
yn[k] = B1(2)* + Bo(3)* (9.66) 


To find the form of forced response yg[k], we use Table 9.2, Pair 4 with r =1,m=1. 
This yields 


yolk] = cık + co 


Therefore 
yolk + 1] = cı(k + 1) + co = cık + c1 + co 
yolk + 2] = cı (k + 2) + co = cık + 2c1 + co 
Also 
f[k] = 3k + 5 
and 
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f[k +1) = 3(k+1)+5=3k +8 


Substitution of the above results in Eq. (9.64) yields 


cık + 2c, + co — 5(cık + c1 + co) + 6(cık + co) = 3k +8 — 5(3k + 5) 
or 


2cık — 3c1 + 2co = —12k ~17 


Comparison of similar terms on the two sides yields 


2c, = — 12 cı = -6 
= 
—3¢e1 + 2co = — 17 


Therefore 


yolk] = -6k - 8 


The total response is 


uk] =yn[k] + yolk] 
=By(2)* + B2(3)"-6k- 38 kk >0 (9.67) 


To determine arbitrary constants Bı and Bz we set k = 0 and 1 and substitute the 
initial conditions y[0] = 4, y[1] = 13 to obtain 


4=Bi +B - 38 ) Bı =28 
= 


13 = 2B, +3B,- 2 Bz = = 

Therefore 

Yn(k] = 28(2)* — 32 (3)" (9.68) 
and 
ylk] = 28(2)* — 3(3)* — 6k ~ $ (9.69) 
—_—_—_e——— ç 
unk] yolk] 

a 


© Computer Example C9.6 
Solve Example 9.10 using MATLAB. 


4(c96.m) 

Y=[4 13]; Y=Y’; 

k=0:10; k=k’; 

f=[5 8];f=f"; 

for m=1:length(k)-2 
y=5*Y(m+1)-6*Y(m)+f(m+1)-5*f(m); 


Y=[Y3 y]; 
F=3*(m+1)+5;f=[f;F]; 
end 


stem(k,Y) © 
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A Comment on Initial Conditions 


This method requires auxiliary conditions y[0], y{1], ..., y[n — 1] for the reasonk 
explained on p. 142. If we are given the initial conditions y[—1], y[—2],..., y[—nl, - 
we can derive the conditions y[0], y[1],...,y[n — 1] using iterative procedure. 


An Exponential Input 


As in the case of continuous-time systems, we can show that for a system 
specified by the equation 


Q[E]y[k] = P[E] f [k] (9.70) 


the forced response for the exponential input f(k] = r* is given by 


yolk] = Hfr" r#y (9.71) 
where Pir] 
H= a (9.72) 


The proof follows from the fact that if the input f[k] = r*, then from Table 9.2 
(Pair 4), yg{k] = cr. Therefore 


EŻf[k] = flk +i] =r"t = rêr" and — P[E]f[k] = Plrjr* 
Ev yg{k] = yolk + 1] = crfti = crdr* and  Q[E]y[k}] = cQfr]r" 


so that Eq. (9.70) reduces to 
cQ[r]rë = P[r]r" 


which yields c = P(r]/Q[r] = Hfr]. 
This result is valid only if r is not a characteristic root of the system. If r is a 
characteristic root, the forced response is ckr? where c is determined by substituting 


y¢[k] in the system equation and equating coefficients of similar terms on the two 
sides. Observe that the exponential r* includes a wide variety of signals such as 
a constant C, a sinusoid cos (@k + 6), and an exponentially growing or decaying 
sinusoid |y|* cos (8k + 6). 


1. A Constant Input f[k] = C 
This is a special case of exponential Cr* with r = 1. Therefore, from Eq. 
(9.71), we have 
P[1] 


yolk] = Cony =CH{i] (9.73) 


2. A Sinusoidal Input 
The input e79* is an exponential r* with r = eff. Hence 


P{e?4] eiBk 


yolk] = H [etf] = Gla] 
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Simnilarly, for the input e~J6* 
volk] = H[eP?]_~s08 
Consequently, if the input f[k] = cos Bk = F (eiPk 4 e7iBbk), 
yolk] = 3 {H [etf]et F + H [e73b]e-1Pk] 


Since the two terms on the right-hand side are conjugates 


volk] = Re {H [eP |e} 
If 


H [e] = |H[eF)_5 4 Mle 


yo[k] =Re { |H [e®]| ei(2k+L He) } 


=|H [eff] cos (Bk + LH[e%4]) (9.74a) 


Using a similar argument, we can show that for the input 


Ff [k] = cos (Bk + 8) 
valk] = |H[e7*]| cos (Bk + 6 + LH [e%)) (9.74b) 


E Example 9.11 
For a system specified by the equation 


(E? -3E + 2)y(k] = (E + 2) f[k] 


find the forced response for the input f [k] = (3)*ufk). 
In this case 


Pir} or +2 
Qr] r?—3r42 


and the forced response to input (3)*u{k] is H (3](3)*; that is, 


H[r] = 


3+2 


yolk] = Gy? —3@) 22 


(3)* = 3 (3)" k>0 E 


E Example 9.12 
For an LTID system described by the equation 


(E? — E + 0.16)y[k] = (E + 0.32) f[k] 


determine the forced response yg[k] if the input is 


F[k] = cos (2k + 4 )u[k] 


| 
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Here 
_ Pfr] r+ 0.32 


Qir] =r? -7r+0.16 
For the input cos (2k + 3 uk], the forced response is 


yolk] = |H [e?]| cos (2k +54 LH [e??]) ufk] 


where 
Hie} = e?? +0.32 A (—0.416 + 70.909) + 0.32 
© (€3)2? =e? +0.16 (—0.654 — 70.757) — (—0.416 + 70.909) + 0.16 
= 0.548¢79-294 
Therefore 
|H[e?"]|=0.548 and H{e??] = 3.294 
so that 


yolk] =0.548 cos (2k + % + 3.294)u[a] 
=0.548 cos (2k +4.34)u[k] E 


Assessment of the Classical Method 


The remarks in Chapter 2 concerning the classical method for solving differen- 
tial equations (p. 147) also apply to difference equations. 


9.6 System Stability 


Just as in a continuous-time system, we define a discrete-time system to be 
asymptotically stable if, and only if, the zero-input response approaches zero as 
k — oo. If the zero-input response grows without bound as k > oo, the system 
is unstable. If the zero-input response neither approaches zero nor grows without 
bound, but remains within a finite limit as k = oo, the system is marginally 
stable. In the last case, the zero-input response approaches a constant or oscillates 
with a constant amplitude. Recall that the zero-input response consists of the 
characteristic modes of the system. The mode corresponding to a characteristic 
root y is y*. To be more general, let y be complex so that 


y=|rle? and 7* = |y|ked®* 


Since the magnitude of eJ* is always unity regardless of the value of k, the magni- 
tude of y% is |y|*. Therefore 


if iy} <1, y* +0 as k — 00 
if jyf>1, y* 00 as k + œ 


and if fyJ=1, |y[*=1 for allk 
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Fig. 9.6 Characteristic roots location and system stability. 
It is clear that a system is asymptotically stable if and only if 


lvl <1 i=1,2,---,n 


These results can be grasped more effectively in terms of the location of charac- 
teristic roots in the complex plane. Figure 9.6 shows a circle of unit radius, centered 
at the origin in a complex plane. Our discussion clearly shows that if all charac- 
teristic roots of the system lie inside this circle (unit circle), |y;| < 1 for all i and 
the system is asymptotically stable. On the other hand, even if one characteristic 
root lies outside the unit circle, the system is unstable. If none of the characteristic 
roots lie outside the unit circle, but some simple (unrepeated) roots lie on the circle 
itself, the system is marginally stable. If two or more characteristic roots coincide 
on the unit circle (repeated roots), the system is unstable. The reason is that for 
repeated roots, the zero-input response is of the form k"™~!7*, and if jy| = 1, then 
\kT—4y*] = kT) ~» oo as k > co.t Note, however, that repeated roots inside 
the unit circle do not cause instability. Figure 9.7 shows the characteristic modes 
corresponding to characteristic roots at various locations in the complex plane. To 
summarize: 


1. An LTID system is asymptotically stable if and only if all the characteristic 
roots are inside the unit circle. The roots may be simple or repeated. 


2. An LTID system is unstable if and only if either one or both of the following 
conditions exist: (i) at least one root is outside the unit circle; (ii) there are 
repeated roots on the unit circle. 


3. An LTID system is marginally stable if and only if there are no roots outside 
the unit circle and there are some unrepeated roots on the unit circle. 


{If the development of discrete-time systems is parallel to that of continuous-time systems, we 
wonder why the parallel breaks down here. Why, for instance, aren’t LHP and RHP the regions 
demarcating stability and instability? The reason lies in the form of the characteristic modes. In 
continuous-time systems we chose the form of characteristic mode as e>it. In discrete-time systems 
we choose the form (for computational convenience) to be oF . Had we chosen this form to be e*#* 
where yi = eò, then LHP and RHP (for the location of Ai) again would demarcate stability and 
instability. The reason is that if y = eô, |y] = limplies|e*| = 1, and therefore À = jw. This shows 
that the unit circle in y plane maps into the imaginary axis in the plane. 
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Complex plane 


k> 


Fig. 9.7 Characteristic roots location and the corresponding characteristic modes. 
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E Example 9.13 

Determine whether the systems specified by the following equations are asymptoti- 
cally stable, marginally stable, or unstable. In each case plot the characteristic roots in 
the complex plane. 


(a) yk + 2] + 2.5y[k + 1] + y[k] = f[k + 1} — 2f{k] 
(b) yik] — yik — 1] + 0.21y[k — 2] = afk — 1] + 3f[k — 2] 
(c) yik +3] + 2yfk +2] + 3y[k +1] + tyfk] = f[k +1] 
(d) (E? — E + 1)°y[k] = (3E + 1)f[k] 
(a) The characteristic polynomial is 
Y + 2.57 +1 = (7 +0.5)(y + 2) 


The characteristic roots are —0.5 and —2. Because | — 2| > 1 (—2 lies outside the unit 
circle), the system is unstable (Fig. 9.8a). 


(b) The characteristic polynomial is 
Y? — 7 +0.21 = (7 — 0.3)(y — 0.7) 


The characteristic roots are 0.3 and 0.7, both of which lie inside the unit circle. The system 
is asymptotically stable (Fig. 9.8b). 


(c) The characteristic polynomial is 


ER? + 8y4h = (yt? ty44) = (74 (7 405- j0.5)(y + 0.5 + 70.5) 


The characteristic roots are —1, —0.5 + 50.5 (Fig. 9.8c). One of the characteristic roots 
is on the unit circle and the remaining two roots are inside the unit circle. The system is 
marginally stable. 


(d) The characteristic polynomial is 
2 2 
2 2: a 1 y3 1 A 
(Y-y+1) = (1-4-3) ( =$473) 
The characteristic roots are 3 + je = letJ3 repeated twice, and they lie on the unit 
circle (Fig. 9.8d). The system is unstable. I 


A Exercise E9.13 
Find and sketch the location in the complex plane of the characteristic roots of the system 
specified by the following equation: 


(E+ 1)(E? + 6E + 25)y[k] = 3E fk] 
Is this a stable, unstable, or marginally stable system? Answer: unstable. y 


A Exercise E9.14 
Repeat Prob. E9.13 for 


(E — 1)?(E + 0.5)y[k] = (E? + 2E + 3) f[k] 
Answer: unstable. y 


9.6-1 System Response to Bounded Inputs 


As in the case of continuous-time systems, asymptotically stable discrete-time 
systems have the property that every bounded input produces a bounded output. 
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complex plane 


Fig. 9.8 Location of characteristic roots for systems in Example 9.13. 


In contrast, for a marginally stable and unstable system it is possible to find a 
bounded input that produces unbounded output. To prove this result we recall 
that 


vlk] =hfk] + fk] 
SS hafik] 
and — 
TEDD misle ml 
<S heiii- 


If f [k] is bounded, then |f [k — m]| < Kı < oo, and 


co 


vik < K Y [atm 


m=- 


Clearly the output is bounded if the summation on the right-hand side is bounded; 
that is, if 
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co 
ŞO |Alk]] < K2 < œ (9.75) 
k=-00 


For an asymptotically stable system 
hfk] = (crvf + cok +--+ + eny*)ufk] 


with the characteristic roots 71, Y2, ... Yn lying within the unit circle. Under these 
conditions h[k] satisfies Eq. (9.75).+ Therefore, the response of an asymptotically 
stable system to a bounded input is also bounded. Moreover, we can show that 
for an unstable or marginally stable system, the response is unbounded for some 
bounded input. As seen in Sec. 2.6-1, these results lead to the formulation of an 
alternate definition of system stability. A system is said to be stable in the sense of 
having bounded output for every bounded input (BIBO stability) if and only if its 
impulse response h[k] satisfies Eq. (9.75). Condition (9.75) is sufficient for a system 
to produce bounded output for any bounded input. It is relatively easy to show 
that it is also a necessary condition; that is, for a system that violates (9.75), there 
exists a bounded input that produces unbounded output (see Prob. 9.6-2). Note 
that an asymptotically stable system is always BIBO-stable.t 


9.6-2 Intuitive Insights Into System Behavior 


The intuitive insights into the behavior of continuous-time systems and their 
qualitative proofs, discussed in Sec. 2.7, also apply to discrete-time systems. For 
this reason, we shall merely mention here some of these insights without discussion 
or proof. The interested reader should read Sec. 2.7 for more explanation. 

The system’s behavior is strongly influenced by the characteristic roots (or 
modes) of the system. The system responds strongly to input signals similar to its 
characteristic modes, and responds poorly to inputs very different from its charac- 
teristic modes. In fact, when the input is a characteristic mode of the system, the 
response goes to infinity provided that the mode is a nondecaying signal. This is 
the resonance phenomenon. The width of an impulse response h[k] indicates the 
response time (time required to respond fully to an input) of the system. It is the 
time constant of the system.{ Discrete-time pulses are generally dispersed when 


} This conclusion follows from the fact that (see Sec. B.7-4) 


oo oo i 
k k 
i lulk] = ETA il <1 
do milk = SO nat a hil 
k=—00 k=0 


Therefore, if |y;| < 1 for i =1,2,...,n, 


= A oa 
> Ih[k]] Ss DS ha < œ 


k=—00 i= 


Although we have assumed all the roots to be distinct in this derivation, it is also valid for repeated 
roots provided that they lie inside the unit circle. 


{The converse is not true. See footnote on p. 152. 


{This part of the discussion applies to systems with impulse response h{k] that is a mostly positive 
(or mostly negative) pulse. 
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passed through a discrete-time system. The amount of dispersion (or spreading 
out) is equal to the system time constant (or width of h[k]). 


9.7 Appendix 9.1: Determining the Impulse Response 


For a discrete-time system specified by Eq. (9.27), we have demonstrated that 


h[k] = Aod{k] + yn[k]ul A] (9.76) 
We now show that i 
Ag = — (9.77) 
ao 


To prove this point, we substitute Eq. (9.76) in Eq. (9.28) to obtain 


QIE] (Ao6[k] + yn[k]u[k]) = P[E]6[k] (9.78) 
Because y,,[k]u[k] is a sum of characteristic modes,} {see Eq. (9.12a)} 
QIE] (yn[k]ufk]) =0 &>0 (9.79) 


Equation (9.78) now reduces to 


AoQ[E]6[k] = P[E]6[k] k20 


or 


Ao(6[k +n] + an—16[k +n — 1] +--+ +0 6[k + 1] + a06[k]) = bnd[k + n] 
+ bp—16[k +n — 1] +--+ +015[k +1) + bod[k] &>0 


If we set k = 0 in this equation and recognize that 6{0] = 1 and 6[m] = 0 when 
m #0, all but the last terms vanish on both sides, yielding 


Aoao = bo 

and bo 
Ag = 2 

ao 


A Special Case: ap = 0 i 
In this case Ap = fo becomes indeterminate. The procedure has to be modified 
slightly. When ap = 0, Q[E] can be expressed as EQ[E}, and Eq. (9.28) can be 
expressed as X 
EĜIE]h[k] = P[E]ó[k] 


If we recognize that 4 is a delay operator, this equation can be rearranged as 


Note that 
QIE] (yn {k]) = 0 
for all k. But if we restrict the mode terms to be causal, the equation is valid only for k > 0; that 


15, 
QIE] (ynfklufk])=0 k20 
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Q[E]A[] = P(E] ($őlk]) = PIE]S[k — 1] 


In this case the input vanishes not for k > 1, but for k > 2. Therefore, the response 
consists not only of the zero-input term and an impulse Ao6 [k] (at k = 0), but also 
of an impulse A,6[k — 1] (at k = 1). Therefore 


h[k] = Aoô[k}] + A16[k — 1] + yn[k]u[k] 


We can determine the unknowns Ag, A;, and the n coefficients in yn{k] from the 
n + 2 number of initial values h[0], A[1], ---, h[n +1], determined as usual from the 
iterative solution of the equation Q[E]h[k] = P[E]6{k]. Similarly, if ag = a, = 0, 
we need to use the form h{k] = Aoé{k] + A15[k — 1] + Aod[k — 2] + yn{klufk]. The 
n +3 unknown constants are determined from the n + 3 values h[0], hl], ---, hin + 
1], h[n + 2], determined iteratively, and so on. 


9.8 Summary 


This chapter discusses time-domain analysis of LTID (linear, time-invariant, 
discrete-time) systems. The analysis is parallel to that of LTIC systems, with some 
minor differences. Discrete-time systems are described by difference equations. For 
an nth-order system, n auxiliary conditions must be specified for a unique solution 
to an input starting at k = 0. Characteristic modes are discrete-time exponentials 
of the form yë corresponding to an unrepeated root y, and the modes are of the 
form k*y* corresponding to a repeated root y. 

The unit impulse function 6[k] is a sequence of a single number of unit value 
at k = 0. The unit impulse response h{k] of a discrete-time system is a linear 
combination of its characteristic modes.t 

The zero-state response (response due to external input) of a linear system 
is obtained by breaking the input into impulse components and then adding the 
system responses to all the impulse components. The sum of the system responses 
to the impulse components is in the form of a sum, known as the convolution sum, 
whose structure and properties are similar to the convolution integral. The system 
response is obtained as the convolution sum of the input f[k] with the system’s 
impulse response h{k]. Therefore, the knowledge of the system’s impulse response 
allows us to determine the system response to any arbitrary input. 

LTID systems have a very special relationship to the everlasting exponential 
signal z* because the response of an LTID system to such an input signal is the 
same signal within a multiplicative constant. The response of an LTID system to 
the everlasting exponential input z* is H[z]z*, where H [z] is the transfer function 
of the system. 

The stability criterion in terms of the location of characteristic roots of the 
system can be summarized as follows: 


1. An LTID system is asymptotically stable if and only if all the characteristic 
roots are inside the unit circle. The roots may be repeated or unrepeated. 


2. An LTID system is unstable if and only if either one or both of the following 


There is a possibility of an impulse 6[k] in addition to characteristic modes. 
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conditions exist: (i) at least one root is outside the unit circle, (ii) there are 
repeated roots on the unit circle. 


3. An LTID system is marginally stable if and only if there are no roots outside 
the unit circle, and there are some unrepeated roots on the unit circle. 


According to an alternate definition of stability—the bounded-input bounded- 
output (BIBO) stability—a system is stable if and only if every bounded input 
produces a bounded output. Otherwise the system is unstable. An asymptotically 
stable system is always BIBO-stable. The converse is not necessarily true. 

Difference equations of LTID systems can also be solved by the classical method, 
where the response is obtained as a sum of natural and forced responses. These are 
not the same as the zero-input and zero-state components, although they satisfy the 
same equations, respectively. Although simple, this method suffers from the fact 
that it is applicable to a restricted class of input signals, and the system response 
cannot be expressed as an explicit function of the input. These limitations make it 
useless in the theoretical study of systems. 


Problems 


9.1-1 Solve iteratively (first three terms only): 


(a) y[k + 1] — 0.5y[k] = 0, with y[—1] = 10 
(b)y[k + 1] + 2y[k] = f[k +1), with f[k] = e~*ulk] and y[—1] = 0 


9.1-2 Solve the following equation iteratively (first three terms only): 


ylk] — 0.6y{k — 1] — 0.16y[& — 2] = 0 with y[-1] = —25, y[-2] = 0 


9.1-3 Solve iteratively the second-order difference Eq. (8.26b) in chapter 8 (first three terms 
only), assuming y[—1] = y[—2] = 0 and f[k] = 100u[k]. 
9.1-4 Solve the following equation iteratively (first three terms only): 


ylk + 2] + 3y[k + 1] + 2y[k] = f[k + 2] + 3f[k + 1] + 3fİk] 
with f[k] = (3)*u[k], y[—1] = 3, and y[—2] = 2 
9.1-5 Repeat Prob. 9.1-4 if 
ylk] + 2yfk — 1] + yik — 2] = 2f{k] - f[k — 1] 


with f[k] = (3)~*ufk}, y[—1] = 2, and y[—2] = 3. 


9.2-1 Solve 

ylk + 2] + 3y[k + 1] + 2y[k] =0 if y[—1] = 0, y[-2] = 1 
9.2-2 Solve 

ylk + 2} + 2yfk + 1] + yf[k] =0 if y[-1] =1, y[-2] =1 
9.2-3 Solve 


yk + 2] — 2y[k + 1] + 2y[k] = 0 if y[—1] = 1, y[-2] = 0 


9.2-4 Find v[k], the voltage at the kth node of the resistive ladder depicted in Fig. P8.5-5 
in Chapter 8, if V = 100 volts and a = 2. 
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9.3-1 


9.3-2 


9.3-3 


9.3-4 


9.3-5 


9.4-1 


9.4-2 


9.4-3 


9.4-4 


9.4-5 
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Hint: The difference equation for v[k] is given in Prob. 8.4-5. The auxiliary conditions 
are v[0] = 100 and v[N] = 0. 
Find the unit impulse response h{k}] of a system specified by the equation 
ylk + 1] + 2y[k] = fik] 

Repeat Prob. 9.3-1 if 

yik + 1] + 2y[k] = fik + 1] 
Repeat Prob. 9.3-1 if 

(E? — 6E + 9)y[k] = E f{k] 
Repeat Prob. 9.3-1 if 

ylk] — 6y[k — 1] + 25y[k — 2] = 2f[k] ~- 4f[k — 1] 
For the general nth-order difference Eq. (9.9), if 
ao = a, = 02 = -= Gn-1 = 0 


the resulting equation is called a nonrecursive difference equation. ae 
(a) Show that the impulse response of a system described by this equation is 


hk] = bnôfk] + bn-1ôfk — 1] +--+ + brd[k — n + 1] + b0d[k — n] 


Hint: Express the system equation in delay-operator form. ; 
(b) Find the impulse response of a nonrecursive LTID system described by the equa- 


tion 
ylk] = 3f[k] — 5f[k — 1) - 2f[k — 3] 


Observe that the impulse response has only a finite (n) number of nonzero elements. 
For this reason, such systems are called finite impulse response (FIR) systems. 
For a general recursive case [Eq. (9.9)], the impulse response has an infinite number 
of nonzero elements, and such systems are called infinite impulse response (ITR) 
systems. 


Find the (zero-state) response y[k] of an LTID system whose unit impulse response 
is 


hfk) = (-2)*ulh] 


and the input is f[k] = e~*u[k]. 
Repeat Prob. 9.4-1 if 
hik] = ${6{%] - (—2)" Jul] 


Repeat Prob. 9.4-1 if the input f[k] = (3)**?u[k], and 
hik] = [(2)* + 3(~5)"lu[k] 
Repeat Prob. 9.4-1 if the input f[k] = (3)~*u{k], and 
h{k] = 3k(2)*ufk] 


Repeat Prob. 9.4-1 if the input f[k] = (2)*ulk], and 
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9.4-6 


9.4-7 


9.4-8 


9.4-9 


9.4-10 


9.4-11 


A[k] = (3)* cos (Zk — 0.5)ulk] 


Find the total response of a system specified by the equation 
ylk + 1] + 2y[k] = fik +1] 


if y[-1] = 10, and the input f[k] = e~*ufk]. 


Repeat Prob. 9.4-1 if the impulse response h[k] = (0.5)*u{k], and the input f{k] is 
(a) 2*u[k} (b)2%-Dufk]  (c) 2*ulk — 2}. 


Hint: You may need to use the shift property (9.46) of the convolution. 


In the savings account problem described in Example 8.5 (chapter 8), a person de- 
posits $500 at the beginning of every month, starting at k = 0 with the exception at 
k = 4, when instead of depositing $500, she withdraws $1000. Find y[k] if the interest 
rate is 1% per month (r = 0.01). 
Hint: Because the deposit starts at k = 0, the initial condition y[—1] = 0. Withdrawal 
is a deposit of negative amount. 


To pay off a loan of M dollars in N payments using a fixed monthly payment of P 
dollars, show that 


= r(ltr)% 
P= urA 


where r is the interest rate per dollar per month. 


Hint: This problem can be modeled by Eq. (8.24) with the payments of P dollars 
starting at k = 1. The problem can be approached in two ways: (1) Consider the 
loan as the initial condition yo[0} = —M, and the input f[k] = Pu[k — 1]. The 
loan balance is the sum of the zero-input component (due to the initial condition) 
and the zero-state component h[k] * f[k]. (2) In the second approach the loan is 
considered as an input —M at k = 0; that is, —-M6|k]. The total input is, therefore, 
fik] = —Mé[k] + Pu[k — 1], and the loan balance is h[k] x f[k]. Because the loan is 
paid off in N payments, set y[N] = 0. 


A person receives an automobile loan of $10,000 from a bank at the interest rate of 
1.5% per month. His monthly payment is $500, with the first payment due one month 
after he receives the loan. Compute the number of payments required to pay off the 
loan. Note that the last payment may not be exactly $500. 

Hint: Follow the procedure in Prob. 9.4-9 to determine the balance y[k]. To determine 
N, the number of payments, set y[N] = 0. In general, N will not be an integer. The 
number of payments K is the largest integer < N. The residual payment is |y[K]]|. 


Using the sliding-tape algorithm, show that 


(a) ufk] + u[k] = (k + 1)ulk] 
(b) (ulk] — u[k — m]) * u[k] = (k + 1)u[k] — (k —m + 1)u[k — m] 
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Fig. P9.4-14 


9.4-12 Using the sliding-tape algorithm, find f[k] *9[k] for the signals shown in Fig. P9.4-12. 
9.4-13 Repeat Prob. 9.4-12 for the signals shown in Fig. P9.4-13. 
9.4-14 Repeat Prob. 9.4-12 for the signals depicted in Fig. P9.4-14. 


9.4-15 The convolution sum in Eq. (9.48) can be expressed in a matrix form as 


Pe 0 O > 0 7 FFlO] 
sij ja) Af] OY FE 
ylk] d Laik] hik-1] +- -AO Ls Tal 
A ee” 
y H f 
or Joni 
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9.4-16 


9.4-17 
9.5-1 


9.5-2 


and 
f=H`ty 


Knowing h|k] and the output y[k], we can determine the input f[k]. This operation 
is the reverse of the convolution and is known as the deconvolution. Moreover, 
knowing f[k] and y[k}], we can determine hfk]. This can be done by expressing the 
above matrix equation as k + 1 simultaneous equations in terms of k + 1 unknowns 
h[0], [1], ... , h[k]. These equations can readily be solved iteratively. Thus, we can 
synthesize a system that yields a certain output y[k] for a given input f[k]. 

(a) Design a system (that is, determine A[k] ) that will yield the output sequence (8, 
12, 14, 15, 15.5, 15.75, ---) for the input sequence (1, 1, 1, 1, 1, 1, ---). 

(b) For a system with the impulse response sequence (1, 2, 4, - - -), the output sequence 
was (1, 7/3, 43/9, ---). Determine the input sequence. 


The sliding-tape method is conceptually quite valuable in understanding the convolu- 
tion mechanism. Numerical convolution can also be performed from the arrays using 
the sets f [0], f[1], f[2], ..., and g[0], g[1], 9[2], ..., as depicted in Fig. P9.4-16. The 
ijth element (element in the ith row and jth column) is given by g[i]f[j]. We add the 
elements of the array along its diagonals to produce c[k] = f[k] *g[k]. For example, if 
we sum the elements corresponding to the first diagonal of the array, we obtain c(0]. 
Similarly, if we sum along the second diagonal, we obtain c[1], and so on. Draw the 
array for the signals f(k] and g[k] in Example 9.9, and find f[k] « g[k]. 


c [0] c [2] 


c [1] 


-A e p 
fio feo feio fB eee 


F (038 11) fle tl f i2] [1] file (1) k a ea 


fT fO file FBl ee 
fig fM fB BRB te 
Fig. P9.4-16 


Using Eq. (9.58), show that the transfer function of a unit delay is H [z] = 1/z. 
Using the classical method, solve 

ylk + 1] + 2y[k] = fik + 1] 
with the input f[k] = e~*u[k], and the auxiliary condition y[0] = 1. 


Using the classical method, solve 


ylk] + 2y[k — 1] = f{& — 1} 
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9.5-3 


9.5-4 


9.5-5 


9.5-6 


9.6-1 


9.6-2 


9.6-3 
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with the input f[k] = e~*u{k] and the auxiliary condition y[—1] = 0. Hint: You will 
have to determine the auxiliary condition y[0] using the iterative method. 


(a) Using the classical method, solve 


yik + 2] + 3yfk + 1] + 2y[k] = f[k +2} + 3f[k + 1] + 3f[k] 


with the input f[k] = (3)* and the auxiliary conditions y[0] = 1, y[1] = 3. 
(b) Repeat (a) if the auxiliary conditions are y[—1] = y[—2] = 1. Hint: Using the 
iterative method, determine y[0] and y{1]. 


Using the classical method, solve 


yik] + 2y[k — 1] + ylk — 2] = 2f[k] — f[k - 1] 
with the input f{k] = 3~*u[k] and the auxiliary conditions y[0] = 2 and y[1] = —%. 


Using the classical method, solve 


(E? — E + 0.16)y[k] = Ef [k] 
with the input f[k] = (0.2)*u[k] and the auxiliary conditions y[0] = 1, y[1] = 2. Hint: 
The input is a natural mode of the system. 


Using the classical method, solve 


(E? — E + 0.16)y[k] = Ef [k] 


with the input f[k] = cos (3E + %)u[k] and the initial conditions y{—1] = y[-2] = 0. 
Hint: Find y(0} and y[1] iteratively. 

Each of the following equations specifies an LTID system. Determine whether these 
systems are asymptotically stable, unstable, or marginally stable. 


(a) ylk + 2] + 0.6y[k + 1] — 0.16y[k] = f[k + 1] — 2f[k] 
(b) (E? + 1)(E? + E + 1)y[k] = Ef{k] 

(c) (E — 1)°(E + 3)ylk] = (E + 2)f [k] 

(d) y[k] + 2y[k — 1] + 0.96y[k — 2] = 2f[k — 1] + 3f[k — 3} 
(e) (E? — 1)(E? + 1)ylk] = fik] 


In Sec. 9.6 we showed that for BIBO stability in an LTID system, it is sufficient for 
its impulse response hfk] to satisfy Eq. (9.75). Show that this is also a necessary 
condition for the system to be BIBO-stable. In other words, show that if Eq. (9.75) 
is not satisfied, there exists a bounded input that produces unbounded output. 
Hint: Assume that a system exists for which h{k] violates Eq. (9.75), yet its output 
is bounded for every bounded input. Establish contradiction in this statement by 
considering an input f[k] defined by f[ki — m] = 1 when h[{m] > 0 and f[ki — m] = 
—1 when h[m] < 0, where kı is some fixed integer. 

Show that a marginally stable system is BIBO-unstable. Verify your result by consid- 


ering a system with characteristic roots on the unit circle and show that for the input 
of the form of the natural mode (which is bounded), the response is unbounded. 


Fourier Analysis of | 
Discrete-Time Signals 


In Chapters 3, 4, and 6, we studied the ways of representing a continuous-time 
signal as a sum of sinusoids or exponentials. In this chapter we shall discuss similar 
development for discrete-time signals. Our approach is parallel to that used for 
continuous-time signals. We first represent a periodic f [k] as a Fourier series formed 
by a discrete-time exponential (or sinusoid) and its harmonics. Later we extend this 
representation to an aperiodic signal f[k] by considering f[k] as a limiting case of 
a periodic signal with the period approaching infinity. 


10.1 Periodic Signal Representation by Discrete-Time 
Fourier Series (DTFS) 


A periodic signal of period No is called an No-periodic signal. Figure 8.9 shows 
an example of a periodic signal of period 6. A continuous-time periodic signal of 
period Tp can be represented as a trigonometric Fourier series consisting of a si- 
nusoid of the fundamental frequency wo = #, and all its harmonics (sinusoids of 
frequencies that are integral multiples of wo). The exponential form of the Fourier 
series consists of exponentials 7, etiwot, etj2wot, etj3wot |... For a parallel de- 
velopment of the discrete time case, recall that the frequency of a sinusoid of period 
No is Qo = 2x/No. Hence, an No-periodic discrete-time signal f[k] can be rep- 
resented by a discrete-time Fourier series with fundamental frequency Qo = E 
and its harmonics. As in the continuous-time case, we may use a trigonometric or 
an exponential form of the Fourier series. Because of its compactness and ease of 
mathematical manipulations, the exponential form is preferable to the trigonomet- 
ric. For this reason we shall bypass the trigonometric form and go directly to the 
exponential form of the discrete-time Fourier series. 

The exponential Fourier series consists of the exponentials e7°*, e+/%ok, ¢+J2%0k, 

, etinQok | and so on. There would be an infinite number of harmonics, 
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except for the property proved in Sec. 8.2: that discrete-time exponentials whose 
frequencies are separated by 2m (or integral multiples of 27) are identical because 


ei (NL2m)k = eJ 20k = ei Mk (10.1) 


The consequence of this result is that the rth harmonic is identical to the (r + No)th 
harmonic. To demonstrate this, let gn denote the nth harmonic e/"*, Then 


(r+No)Qok _ ef (rQok+2rk) = edt Qok = 


Gr+No =e? gr (10.2) 


and 
gr = 9r+No = Grt2Ny = © = Jr4mNo m, integer (10.3) 


Thus, the first harmonic is identical to the (No +1)st harmonic, the second harmonic 
is identical to the (No+2)nd harmonic, and so on. In other words, there are only No 
independent harmonics, and they range over an interval 27 (because the harmonics 
are separated by Qo = A We may choose these No independent harmonics as 
eit %k over 0 < r < No- 1, or over —1 < r < No — 2, or over 1 < r < No, or over 
any other suitable choice for that matter. Every one of these sets will have the same 
harmonics, although in different order. Let us take the first choice (0 < r < No- 1). 
This choice corresponds to exponentials ef"9oF for r = 0, 1, 2, ..., No— 1. The 
Fourier series for an No-periodic signal f[k] consists of only these No harmonics, 
and can be expressed as 


pam . 2r 
FI] = JO Dreta M9 = (10.4) 
r=0 0 


‘To compute coefficients D, in the Fourier series (10.4), we multiply both sides of 
(10.4) by e~9™%oF and sum over k from k = 0 to (No — 1). 


No-1 ; No-1 No~1 ; 
D err SE Dre ie (10.5) 
k=0 k=0 r=0 


The right-hand sum, after interchanging the order of summation, results in 


No-1 No-1 
> Dy p Jai (10.6) 


r= k=0 


The inner sum, according to Eq. (5.43), is zero for all values of r # m. It is nonzero 
with a value No only when r = m. This fact means the outside sum has only one 
term DmNo (corresponding to r = m). Therefore, the right-hand side of Eq. (10.5) 


is equal to D,,No, and 
No-1 


SO flkle Ik = Dm No 
k=0 
and 


1 No~i 
Din => De flee (10.7) 
k=0 
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We now have a discrete-time Fourier series (DTFS) representation of an No-periodic 
signal f[k] as 


No-1 
fk] = $ Dreta (10.8) 
r=0 
where 
D, =L Y5 plejere wss (10.9) 
T Mo k=0 4 ° No 


Observe that DTFS equations (10.8) and (10.9) are identical (within a scaling con- 
stant) to the DFT equations (5.18b) and (5.18a).t Therefore, we can compute the 
DTFS coefficients using the efficient FFT algorithm. 


10.1-1 Fourier Spectra of a Periodic Signal f{k] 


The Fourier series consists of No components 


jQOk j2Nok j(No—1)Qok 
Do, Die?**, Doe? yee Dm- 0-1) 


The frequencies of these components are 0, No, 2p, ..-, (No — 1)No where Qo = 
2n/No. The amount of the rth harmonic is D,. We can plot this amount D, (the 
Fourier coefficient) as a function of Q. Such a plot, called the Fourier spectrum of 
fk], gives us, at a glance, the graphical picture of the amounts of various harmonics 
of f [k]. 
In general, the Fourier coefficients D, are complex, and they can be represented 
in the polar form as 
D, = |D, let? (10.10) 


The plot of |D,| vs. Q is called the amplitude spectrum and that of ZD, vs. Q is 
called the angle (or phase) spectrum. These two plots together are the frequency 
spectra of f[k]. Knowing these spectra, we can reconstruct or synthesize f[k] ac- 
cording to Eq. (10.8). Therefore, the Fourier (or frequency) spectra, which are an 
alternative way of describing a signal f[k], are in every way equivalent (in terms 
of the information) to the plot of f[k] as a function of k. The Fourier spectra of 
a signal constitute the frequency-domain description of f[k], in contrast to the 
time-domain description, where f[k] is specified as a function of time (k). 

The results are very similar to the representation of a continuous-time periodic 
signal by an exponential Fourier series except that, generally, the continuous-time 
signal spectrum bandwidth is infinite, and consists of an infinite number of expo- 
nential components (harmonics). The spectrum of the discrete-time periodic signal, 
in contrast, is bandlimited and has at most No components. 


Periodic Extension of Fourier Spectrum 


Note that if [r] is an No-periodic function of r, then 
No-1 


X erl= SO oF] (10.11) 
r=0 


r=<No> 


ff we let f[k] = Nofs and Dr = Fp, Eqs. (10.8) and (10.9) are identical to Eqs. (5.18b) and 
(5.18a), respectively. 
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where r =<.Ng> indicates summation over any No consecutive values of r. This 
follows because the right-hand side of Eq. (10.11) is the sum of all the No consecutive 
values of ¢[r]. Because ¢[r] is periodic, this sum must be the same regardless of 
where we start the first term. Now e~47%* is No-periodic because 


e` Ir NRolk+No) = e ITQok ,—j2ar = e irok 
Therefore, if f[k] is No-periodic, f [k]e—3"0* is also No-periodic. Hence, from Eq. 


(10.9) it follows that D, is also No-periodic, as is D,e#"%*, Now, because of prop- 
erty (10.11), we can express Eqs. (10.8) and (10.9) as 


f= >] Dyer t (10.12) 
r=<No> 
and 
1 —jrQok 
as D ikjet (10.13) 
k=<No> 


If we plot D, for all values of r (rather than only 0 < r < No — 1), then 
the spectrum D, is No-periodic. Moreover, Eq. (10.12) shows that f[k] can be 
synthesized by not only the No exponentials corresponding to 0 < r < No- 1, 
but by any successive No exponentials in this spectrum, starting at any value of r 
(positive or negative). For this reason, it is customary to show the spectrum D, for 
all values of r (not just over the interval 0 < r < No — 1). Yet we must remember 
that to synthesize f|k] from this spectrum, we need to add only Nọ consecutive 
components. 

The spectral components D, are separated by the frequency Q = RA and there 
are a total of No components repeating periodically along the 9 axis. Thus, on the 
frequency scale 2, D, repeats every 2m intervals. Equations (10.12) and (10.13) 
show that both f[k] and its spectrum D, are periodic and both have exactly the 
same number of components (No) over one period. The period of f[k] is No and 
that of D, is 27 radians. 

Equation (10.13) shows that D, is complex in general, and D_, is the conjugate 
of D, if f{k] is real. Thus 


[D,|=|D_-| and D,=-LD_, (10.14) 


so that the amplitude spectrum {D,| is an even function , and ZD, is an odd function 
of r (or Q). All these concepts will be clarified by the examples to follow. 


a Example 10.1 

Find the discrete-time Fourier series (DTFS) for f[k] = sin 0.17k (Fig. 10.1a). Sketch 
the amplitude and phase spectra. 

In this case the sinusoid sin 0.17k is periodic because 2 = 5 is a rational number 
and the period No is [see Eq. (8.9b)] 


2a Qn 
= —j= — } = 2 
No m(T) m (5i) vee 


The smallest value of m that makes 20m an integer is m = 1. Therefore, the period 
No = 20, so that Qo = KA = 0.ir, and from Eq. (10.12) 
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fik] 


Fig. 10.1 Discrete-time sinusoid sin 0.17k and its Fourier spectra. 


fik) = 5D D, ef lark 


r=<20> 


where the sum is performed over any 20 consecutive values of r. We shall select the range 
—10 < r < 10 (values of r from —10 to 9). This choice corresponds to synthesizing f[k] 
using the spectral components in the fundamental frequency range ( —r < N < r). Thus, 


9 
fik] = > Dye}? 17k 


r=~10 


where, according to Eq. (10.13), 


9 
D, = 5 2. h 0.1rk e770 17k 


9 
1 D 1 Ca a nie mb 


a k=—10 J 
1 9 9 
j0.1rk(1—r) —j0.lak(i+r) 
= = e = e 
403 2 D 
k=-10 k=—10 
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In these sums, r takes on all values between —10 and 9. From Eq. (5.43) it follows that 
the first sum on the right-hand side is zero for all values of r except r = 1, when the sum 


is equal to No = 20. Similarly, the second sum is zero for all values of r except r = —1, 
when it is equal to No = 20. Therefore 
1 1 
Dı = > d Da =--> 
Pa. 153 


and all other coefficients are zero. The corresponding Fourier series is given by 


JIk] = sin 0.1rk = $ (70 1™* — e307) (10.15) 
Here the fundamental frequency No = 0.17, and there are only two nonzero components: 
Dı = x = łe737/2 
y 
—_ l _ 1,50/2 
Di = my = te" 


Therefore 
[Dil = {D-1] = 3 


LD, = == and ¿LD = Š 


Figures 10.1b and c shows the sketch of D, for the interval (—10 < r < 10). According 
to Eq. (10.15a), there are only two components corresponding to r = 1 and —1. The 
remaining 18 coefficients are zero. The rth component D, is the amplitude of the frequency 
rQo = 0.1rm. Therefore, the frequency interval corresponding to —10 < r < 10 is —r < 
Q < r, as depicted in Figs. 10.1b and c. This spectrum in the interval —10 < r < 10 (or 
~r < Q < r) is sufficient to specify the frequency-domain description (Fourier series), and 
we can synthesize f[k] by adding these spectral components. Because of the periodicity 
property discussed in Sec. 10.1-1, the spectrum D, is a periodic function of r with period 
No = 20. For this reason, we repeat the spectrum with period No = 20 (or Q = 2r), as 
illustrated in Figs. 10.1b and c, which are periodic extensions of the spectrum in the range 
—10 <r < 10. Observe that the amplitude spectrum is an even function and the angle or 
phase spectrum is an odd function of r (or 2) as expected. 

The result (10.15) is a trigonometric identity, and could have been obtained immedi- 
ately without the formality of finding the Fourier coefficients. We have intentionally chosen 
this trivial example to introduce the reader gently to the new concept of the discrete-time 
Fourier series and its periodic nature. The Fourier series is a way of expressing a periodic 
signal f[k] in terms of exponentials of the form e/”°* and its harmonics. The result in 
Eq. (10.15) is merely a statement of the (obvious) fact that sin 0.1mk can be expressed as 
a sum of two exponentials e7°}"* and e~3°1**, 

Because of the periodicity property of the discrete-time exponentials ¢/™*, the 
Fourier series components can be selected in any range of length No = 20 (or Q = 27). 
For example, if we select the frequency range 0 < 2 < 2r (or 0 < r < 20), we obtain the 
Fourier series as 


f{k] = sin 0.1rk = 5 Co i (10.16) 


This series is equivalent to that in Eq. (10.15) because, as seen in Sec. 8.2, the two expo- 
nentials e71-9** and e~7°-!** are identical. 

We could have selected the spectrum over any other range of width Q = 27 in Figs. 
10.1b and c as a valid discrete-time Fourier series. The reader may satisfy himself by 
proving that such a spectrum starting anywhere (and of width Q = 27) is equivalent to 
the same two components on the right-hand side of Eq. (10.15). W 
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A Exercise E10.1 
From the spectrum in Fig. 10.1 write the Fourier series corresponding to the interval —10 > 
r > —30 (or -r > Q > —3z). Show that this Fourier is equivalent to that in Eq. (10.15). Y 


A Exercise E10.2 
Find the period and the DTFS for 


JIk] = 4 cos 0.2rk + 6sin 0.57k 


over the interval 0 < r < 19. Use Eq. (10.9) to compute Dr. 
Answer: 


No =20, and fik] = QeI0-20k + (3e7I7/2)930-50k + (3ei7/2)@31-57k ze Qeil-8rk y 


(b) 


Fig. 10.2 Periodic sampled gate pulse and its Fourier spectrum. 


E Example 10.2 

Find the discrete-time Fourier series for the periodic sampled gate function shown in 
Fig. 10.2a. 

In this case No = 32 and Q% = 22 = iş- Therefore 


32 
fik]= X Dreit (10.17) 
r=<32> 
where 
1 a 
Dr = 35 XO sljer’ (10.18) 
k=<32> 


For our convenience, we shall choose the interval —16 < k < 15 for the summation (10.18), 
although any other interval of the same width (32 points) would give the same result. 


15 
1 —irigk 
De = 35 ` flkle ot 


k=—16 


Now f[k] = 1 for —4 < k < 4 and is zero for all other values of k. Therefore 
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This is a geometric progression with a common ratio e~/16". Therefore,|see Sec. (B.7-4)] 


Dr 


; 5 54 
1 eiT — ef te 
~ 32 e-iis —1 


i e-i E G z atie] 
(a) eee [eo — ef te] 
( 1 ) sin (432°) 
5) So (BP) 
1 \ sin (4.5rQo) 
= (32) sin (05r) Q = i 10. 
(a) sin (0.5rQo) 0 = i6 (10.19) 


This spectrum (with its periodic extension) is depicted in Fig. 10.2b.} a 


© Computer Example C10.1 
Do Example 10.2 using MATLAB. 


N0=32;k=0:N0-1; 

f=[ones(1,5) zeros(1,23) ones(1,4)}; 
Fr=1/32*fft(£); 

r=k; 

stem(k,Fr),grid ©) 


10.2 Aperiodic Signal representation by Fourier Integral 


In Sec. 10.1 we succeeded in representing periodic signals as a sum of (everlast- 
ing) exponentials. In this section we extend this representation to aperiodic signals. 
The procedure is identical conceptually to that in Chapter 4 used for continuous- 
time signals. 

Applying a limiting process, we now show that aperiodic signals f[k] can be 
expressed as a continuous sum (integral) of everlasting exponentials. To represent 
an aperiodic signal f{k] such as the one illustrated in Fig. 10.3a by everlasting 
exponential signals, let us construct a new periodic signal fy, {k] formed by repeating 
the signal f[k] every No units , as shown in Fig. 10.3b. The period No is made long 
enough to avoid overlap between the repeating cycles (No > 2N +1). The periodic 
signal fy, [k] can be represented by an exponential Fourier series. If we let No — co 
, the signal f[k] repeats after an infinite interval, and therefore 


In this example we have used the same equations as those for DFT in Example C5.2, with a 
minor difference. In the present example, the values of f[k] at k = 4 and —4 are taken as 1, 
whereas in Example 5.3 these values are 0.5. This is the reason for the slight difference in spectra 
in Fig. 10.2b and Fig. 5.16d. Unlike continuous-time signals, discrete-time signals can have no 
discontinuity. 


10.2 Aperiodic Signal Representation by Fourier Integral 625 


Fk} 


-No -N 0 N Ny koe 
(b) 


Fig. 10.3 Generation of a periodic signal by periodic extension of a signal f[k]. 


Thus, the Fourier series representing fyn,[k| will also represent f[k] in the limit 
No — œ. The exponential Fourier series for fy,[k] is given by 


fnolk]= $ Dreta qe (10.20) 
r=<No> No 
where 
1 2 : 
Dr = 5 Jo ert (10.21) 
k=—00 


The limits for the sum on the right-hand side of Eq. (10.21) should be from -N 
to N. But because f[k] = 0 for |k] > N, it does not matter if the limits are taken 
from —0o to oo. 

It is interesting to see how the nature of the spectrum changes as No increases. 
To understand this fascinating behavior, let us define F(Q), a continuous function 
of 2, as 


F(Q) = D f[k]e 719 (10.22) 
k=—00 


From this definition and Eq. (10.21), we have 
1 
D, = —F (r9) (10.23) 
No 


This result shows that the Fourier coefficients D, are (1/No) times the samples of 
F(N) taken every No rad/s.} Therefore, (1/No)F (Q) is the envelope for the coeffi- 
cients D,. We now let Ng — oo by doubling No repeatedly. Doubling No halves the 
fundamental frequency Qo so the spacing between successive spectral components 
(harmonics) is halved, and there are now twice as many components (samples) in 


{For the sake of simplicity we assume D, and therefore F(Q) to be real. The argument, however, 
is also valid for complex Dy for F(Q)]. 
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the spectrum. At the same time, by doubling No, the envelope of the coefficients 
D, is halved, as seen from Eq. (10.23). If we continue this process of doubling 
No repeatedly, the number of components doubles in each step; the spectrum pro- 
gressively becomes denser while its magnitude D, becomes smaller. Note, however, 
that the relative shape of the envelope remains the same [proportional to F(Q) in 
Eq. (10.22)]. In the limit, as No — o0, the fundamental frequency No — 0, and 
D, — 0. The separation between successive harmonics, which is Qo, is approaching 
zero (infinitesimal), and the spectrum becomes so dense that it appears continuous. 
But as the number of harmonics increases indefinitely, the harmonic amplitudes 
D, become vanishingly small (infinitesimal). We have a strange situation of hav- 
ing nothing of everything. This phenomenon is already discussed in Chapter 4, 
where we showed that these are the classic characteristics of a familiar phenomenon 
(the density function). 

3 na us see what happens mathematically as the period No — oo. According to 

q. (10.22) 


F(rQo) = J. fikje? F (10.24) 


k=—00 


Using Eqs. (10.23) and (10.21), we can express Eq. (10.20) as 


1 F 
folk] = 5 - So F(rMo) ei oF (10.25a) 
0 p=<No> 
= So F(rM)eio* (2) (10.25b) 
r=<No> T 


In the limit as No > 00, No — 0 and fn, [k] — f[k]. Therefore 


; F(rQo)N0] jro 

kl = JrQok 

m- D [Ae]. (1029 
r=<No> 

As No — 0, Qo becomes infinitesimal (Qo — 0). For this reason it will be appropri- 


ate to replace Qo with an infinitesimal notation AQ: 


2 
AQN= ra (10.27) 
Equation (10.26) can be expressed as 
. F(rAQAQ] ; 
T=<No> 
‘ 1 j 
= lim z YO F(rAM) 7 49F AND (10.29) 
r=<No> 


The range r =< No> implies the interval of No number of harmonics, which is 
NoAQ = 2r according to Eq. (10.27). In the limit, the right-hand side of Eq. 
(10.29) becomes the integral 
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1 . 
fik] = = Í F(Q)e7*? dQ (10.30) 
2r Jon 
where Jon indicates integration over any continuous interval of 27. The spectrum 
F(Q) is given by [Eq. (10.22)] 


o 
F(Q) = $. flle (10.31) 
k=—00 
The integral on the right-hand side of Eq. (10.30) is called the Fourier inte- 
gral. We have now succeeded in representing an aperiodic signal f[(k] by a Fourier 
integral (rather than a Fourier series). This integral is basically a Fourier series (in 
the limit) with fundamental frequency AQ — 0, as seen in Eq. (10.28). The amount 
of the exponential e974 is F(r AQ)AQ/27. Thus, the function F(N) given by Eq. 
(10.31) acts as a spectral function, which indicates the relative amounts of various 
exponential components of f [k]. 
We call F(N) the (direct) discrete-time Fourier transform (DTFT) of f [k], and 
fk] the inverse discrete-time Fourier transform (IDTFT) of F(Q). This can be 
represented as 


F(Q)=F{f{k]} and fik] = F-*{F(Q)} 


The same information is conveyed by the statement that f[k] and F(Q) are a 
(discrete-time) Fourier transform pair. Symbolically, this is expressed as 


fik] = F(Q) 


The Fourier transform F (Q9) is the frequency-domain description of f [k]. 


10.2-1 Nature of Fourier Spectra 


We now discuss several important features of the discrete-time Fourier trans- 
form and the spectra associated with it. 


The Fourier Spectra are Continuous Functions of Q. 

It is helpful to keep in mind that the Fourier integral in Eq. (10.30) is basically 
a Fourier series with fundamental frequency AQ approaching zero (Eq. (10.28)]. 
Therefore, most of the discussion and properties of Fourier series apply to the 
Fourier transform as well. The successive harmonics are separated by the fundamen- 
tal frequency AQ, which approaches zero. This fact makes the spectra continuous 
functions of 2. 


The Fourier Spectra are Periodic Functions of 2 with Period 27 
According to Eq. (10.31) it follows that 


F(Q42n) = > fikle TIt = 5 flk]eI%%e~927* = F(Q) (10.32) 


k=-00 k=--00 


Clearly, the spectrum F(N) is a continuous and periodic function of 2 with period 
2r. We must remember, however, that to synthesize f [k], we need to use the spec- 
trum over a frequency interval of only 27, starting at any value of Q {see Eq. (10.30)]. 
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As a matter of convenience, we shall choose this interval to be the fundamental fre- 
quency range (—7, 7). It is, therefore, not necessary to show discrete-time-signal 
spectra beyond the fundamental range, although we often do so. 


Conjugate Symmetry of F() for real f[k] 
From Eg. (10.31), we obtain 


co 


F(-) = Y felei 


k=—00 


The right-hand side of this equation is the conjugate of the right-hand side of Eq. 
(10.31) for real f[k]. Therefore, for real f[k], F(Q) and F(—Q) are conjugates; that 
is, F(—2) = F*(Q). 
Since F(N) is generally complex, we have both amplitude and angle (or phase) 
spectra 
F(Q) = |F (Qei tE (10.33) 


Because of conjugate symmetry of F(Q), it follows that 
|F(Q)| = |F(-9)| (10.34a) 
LF(Q) = -LF(-2) (10.34b) 


Therefore, the amplitude spectrum |F()| is an even function of Q and the phase 
spectrum ZF (Q) is an odd function of Q for real f [k]. 


Linearity of the DTFT 
According to Eq. (10.31), it follows that if 


fi{k] > F(Q) and f2lk] —S F(Q) 


then 
aifılk] + a2 fo[k] => a1 F(Q) + a2F2({Q) (10.35) 


Existence of the DTFT 
Because |e~7*®| = 1, from Eq. (10.31), it follows that the existence of F(Q) is 
guaranteed if f [k] is absolutely summable; that is, 


XO IFIEll < œ (10.36) 
k=- 


This condition is sufficient but not necessary for the existence of F (Q). For instance, 
the signal f[k] = sin k/k violates the condition (10.36), but does have DTFT (see 
Example 10.6). 


Physical Appreciation of the Discrete-Time Fourier Transform 


In understanding any aspect of the Fourier transform, we should remember that 
Fourier representation is a way of expressing a signal f[k] as a sum of everlasting 
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(a) 


IF ()| 


Fig. 10.4 Exponential +*u{k] and its frequency spectra. 


exponentials (or sinusoids). The Fourier spectrum of a signal indicates the relative 
amplitudes and phases of the exponentials (or sinusoids) required to synthesize 
f[k]. If f [k] is periodic, then its Fourier spectrum has finite amplitudes and exists at 
discrete frequencies (Mp and its multiples). Such a spectrum is easy to visualize, but 
the spectrum of an aperiodic signal is not easy to visualize because it is continuous. 
The physical meaning of the continuous spectrum is fully explained in Sec. 4.1-1. 


E Example 10.3 
Find the DTFT of f{k] = y*uk]. 


This is a geometric progression with a common ratio ye ?®. Therefore, [see Sec. (B.7-4)] 


1 


F(9) = l— ye 
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provided that |ye~¥"] < 1. But because je~#%| = 1, this condition implies |y| < 1. 
Therefore 


FQ) == 1 hi<1 (10.37) 


yeI 


If |y| > 1, F(Q) does not converge. This result is in conformity with condition (10.36). 
From Eq. (10.37) 


1 
ENTE AE ed 10.3: 
F(9) 1 — ycos N+ jysin Q (10.38) 
so that 
1 
|FQ)| = —_—————————— (10.39a) 
(1 — yeos Q)? + (ysin 2)? 
sen ho 
y1 +7- 2ycos Q 
LF(Q) = — tan”! _7sin Q (10.39b) 
zi 1— ycos 2 : 


Figure 10.4 shows f[k] = +*u{k] and its spectra for y = 0.8. Observe that the 
frequency spectra are continuous and periodic functions of 2 with the period 27. As 
explained earlier, we need to use the spectrum only over the frequency interval of 27. We 
often select this interval to be the fundamental frequency range (—7, 7). 

The amplitude spectrum |F()| is an even function and the phase spectrum LF(Q) 
is an odd function of Q. 


fik) 


Fig. 10.5 Exponential y*u{—(k + 1)]. 


E Example 10.4 
Find the DTFT of y*u[—(k + 1)] depicted in Fig. 10.5. 


oo —oo co 
cj -j 1 jQ -k 
F(Q) = kuj—(k+1 jak _ j2yk 1 
(Q)= SO rul-(k+ Dle ders yo Ge 
k=—00 k=-1 k=-1 
Setting k = —m yields 
o0 2 3 
1 jn 1 ja l jn 1 5a 
k] = Hel )™ = me 4 [ =e} +) ee | H 
fik] LG es (G ) G ) 


This is a geometric series with a common ratio e? fy. Therefore, from Sec. B.7-4, 
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FQ) = —1— j>1 10.40 
= Ay ly (10.40) 
2 1 
(ycos Q — 1) — jysin Q 
Therefore 
1 
F(Q) = — 
Y1t 7? -— 2ycos 2 
Ost | (10.41) 
ycos Q—1 Š 


The Fourier transform (and the frequency spectra) for this signal is identical to that of 
fik] = y*ulk]. Yet there is no ambiguity in determining the IDTFT of F(Q) = ist 
because of the restrictions on the value of y in each case. If |y| < 1, then the inverse 
transform is f[k] = y*ufk]. If |y] > 1, it is f[k] =7*[-(k+1)]. E 


fik] 


(a) 


Fig. 10.6 Discrete-time gate pulse and its Fourier spectrum. 


E Example 10.5 
Find the DTFT of the discrete-time rectangular pulse illustrated in Fig. 10.6a. This 
pulse is also known as the 9-point rectangular window function. 


F(Q)= X, fikle 
“a Ps 
ye M=9 (10.42) 


—_M-1 
ke 


This is a geometric progression with a common ratio e~3® and [see Sec. B.7-4] 
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~M+1 ~M—-1 
ea — ef 7 ® 


FO) e792 1 


It 


i : sig 
eI? (e73 $ _ eža) 


@-38/2(e—30/2  ei%2) 


sin (#9) 
™ sin (0.52) (10/43) 
_ sin (4.59) = 
= gin (0.50) for M =9 (10.44) 


Figure 10.6b shows the spectrum F(Q) for M = 9. 
Note that the spectrum D, in Fig. 10.2b (Eq. (10.19)] is a sampled version of F(9) 
in Fig. 10.6b [Eq. (10.44)}: 
= L F(rM%) mace 
cy ap ° 16 
Therefore, F(N) in Fig. 10.6b is the envelope of D, (within a multiplicative constant 32) 
in Fig. 10.2b. The reason for this behavior is discussed later in Sec. 10.6. WE 


© Computer Example C10.2 
Do Example 10.5 using MATLAB. 


NO=512; 

f=[ones(1,5) zeros(1,N0-9) ones(1,4)]; 
F=fft(f); 

r=0:N0-1; 

Wer.*2*pi/512; 

plot(W,F); 
xlabel(’W’);ylabel(’F(W)’);grid on; O 


E Example 10.6 
Find the inverse DTFT of the rectangular pulse spectrum F(Q) = rect Gg) with 


Q. = | and repeating at the intervals of 2r, as shown in Fig. 10.7a. 


According to Eq. (10.30) 
_ 1 Jka 
fik) = = T F(Q) ™ dQ 


Ne 
= FF? go, 


Fanke 


_ sin (Q-k) 
= tk 


Qe . 
= — sine (Qk) (10.45) 
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(b) 


Fig. 10.7 Inverse Discrete-time Fourier transform of a periodic gate spectrum. 


The signal f [k] is depicted in Fig. 10.7b (for the case Qe = 7/4). a 
A Exercise E10.3 
Find and sketch the amplitude and phase spectra of the DTFT of the signal f[k] = Fl with 
I<. 
Answer: 
1-7 


RO= 1 — 2y cos Q +7? 


v 


10.3 Properties of the DTFT 


The linearity property [Eq. (10.35)] of DTFT has been already discussed. 
Other useful properties of the DTFT are as follows: 


Time and Frequency Inversion 
f[-k] 4> F(-Q) (10.46) 
From Eq. (10.31), the DTFT of f{—&] is 


DTFT{s[-k]} = X sikei = SI sme" = F(-2) 


k=—0o m=- 


Multiplication by k: Frequency Differentiation 


kK = j= 


The result follows immediately by differentiating both sides of Eq. (10.31) with 
respect to 2. 


(10.47) 
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Time-Shifting Property 


If 


PA fik] => F(9) 


fik — ko] = F(Q)e 70% ko an integer (10.48) 


This property can be proved by direct substitution in the equation defining the 
direct transform. From Eq. (10.31) we obtain 


fl - ko] => D> fik- hole I = $ fime mt 


k=—00 m=—00 


= e7 Ike ZD flmje7™ = eiF P(N) 


k=—00 


This result shows that delaying a signal by ko units does not change its am- 
plitude spectrum. The phase spectrum, however, is changed by —koQ. This added 
phase is a linear function of Q with slope —ko. 


Physical Explanation of the Linear Phase 

Time delay in a signal causes a linear phase shift in its spectrum. The heuristic 
explanation of this result is exactly parallel to that for continuous-time signals given 
in Sec. 4.3-4 (see Fig. 4.20). 


Frequency-Shifting Property 


If 


fk] = FQ) 
then 


fikle? <> F(Q- Ns) (10.49) 


This property is the dual of the time-shifting property. To prove this property, we 
have from Eq. (10.31) 


fikje e D7 fiee = YT fiee = FR- 2] 


k=—00 k=—00 


Time and Frequency Convolution Property 


If 
filk] => Fi(Q) and folk] 4 F2(Q) 
then 
ilk] * folk] = Fi(Q)F2(2) (10.50a) 
and 
filk folk] + =F) + Fa(O) (10.50b) 
where 
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filkl* folk} = $ film] folk - m] 


m=-co 
and 


PED = f Fı(u)F2(Q — u) du 


The time convolution property is proved in Chapter 11 [Eq. (11.18)]. All we have 
to do is replace z with e°. To prove the frequency-convolution property (10.50b), 
we have 7 


filkl folk] <= ss filk] fzlk]e 19 = 5 fo{k] E f. Fi(u)e I" au| e Ik 


k=- k=—00 
Interchanging the order of summation and integration, we obtain 


k=—0o 


Falk folk] = = f Filu) | D jajem du = 5 | _Fr(w)Fe(O—u) du 


Parseval’s Theorem 
If 
fik] <> F(Q) 


then Es, the energy of f{k], is given by 
= 1 
= i a= 2)|? dQ 10.51 
By= D MAP = 5, [Feo (10.51) 


In order to prove this property, we have from Eq. (10.31) 


fo] 
F*(-2)= D> ft {ke (10.52a) 
k=—00 
This result shows that 
f*[k] 4 F*(-2) (10.52b) 


Now 
co a fore) i 7 oo . i „jok 
È m= $ reme D rafa f rO ao] 


k=—00 k=-00 
=> rol È rom 


on k=- 


1 * a E 2 
Z x [For (0) a= = f F(Q 40 
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f(t) A F(@) 


Fig. 10.8 Connection between the DTFT and the Fourier transform. 


10.4 DTFT Connection with the Continuous-Time Fourier 
Transform 


Consider a continuous-time signal f,(t) (Fig. 10.8a) with the Fourier transform 
F,(w). This signal may or may not be bandlimited. For convenience, we shall 
assume the signal to be bandlimited to B Hz (Fig. 10.8b). This signal is sampled 
with a sampling interval T. The sampling rate may or may not be above the Nyquist 
tate. Again, for convenience, we shall assume that the sampling rate is at least equal 
to the Nyquist rate; that is, T < 1/2B. The sampled signal felt) (Fig. 10.8c) can 
be expressed as 


Fe(t)= D> felkT)5(t — kT) 
k=—00 


The continuous-time Fourier transform of the above equation yields 
co 
Few) = > felkT eT (10.53) 
k=~00 


In Sec. 5.1 (Fig. 5.1e), we have shown that F.(w) is F.(w)/T repeating periodically 
with a period ws = 27r /T, as illustrated in Fig. 10.8d. Let us construct a discrete- 
time signal f[k] such that its kth element value is equal to the value of the kth 
sample of f,(t), as depicted in Fig. 10.8e; that is, 


f{k] = fe(kT) 
Now, F(Q), the DTFT of f[&], is given by 
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k 
fik) @ 


fik] 


HEISA eo) 


Decimation (Downsampling) 


Fig. 10.9 Spectra of the decimated and interpolated signals. 


oo co 
F(= X file" = O sfe(er)eI (10.54) 
k=—00 k=—00 
Comparison of (10.54) with (10.53) shows that 
F(Q) =F. (z) (10.55) 


Thus, F(Q) can be obtained from Fe(w) by replacing w with Q/T. Therefore, F (9) 
is identical to F,(w) frequency-scaled by a factor T, as shown in Fig. 10.8f. 

In the above derivation, we did not have to use the assumption that f,(t) is 
bandlimited or that fe(t) is sampled at a rate at least equal to its Nyquist rate. If 
the signal were not bandlimited, the only difference in our discussion would be in the 
sketches in Fig. 10.8. For instance, F,(w) in Fig. 10.8b would not be bandlimited. 
This fact would cause overlapping (aliasing) of repeating cycles of Fe(w) in Figs. 
10.8d and f. A similar thing happens when the signal f,(¢) is sampled below the 
Nyquist rate.{ 


10.4-1 DTFT of Decimated and Interpolated Signals 
We can use Eq. (10.55) to find the DTFT of decimated and interpolated sig- 


{In case the signal is not bandlimited and/ot the sampling rate is below its Nyquist rate, the 
samples fe(kT) can be interpreted as the Nyquist samples of the inverse Fourier transform of the 


first cycle (centered at w = 0) of TFe(w). 


638 10 Fourier Analysis of Discrete-Time Signals 10.5 Discrete-Time Linear System Analysis by DT FT 639 


nals, which are explained in Fig. 8.17. Consider a signal f{k] and its DTFT F(Q), zk = eJ®k and the response to an everlasting exponential input e?* of an LTID 
as illustrated in Figs. 10.9a and b. Figure 10.9c shows the decimated signal f [2k]. system with transfer function H fz] is H[e?@]e?°*. This result can be represented as 
If f[k] is considered to be the sample sequence of a continuous-time signal f(t), the input-output pair with a directed arrow notation as usual 

then f[2k] is the sample sequence of f,(2t), whose Fourier transform is given by 

t F(w/2) according to Eq. (4.34). As seen in Eq. (10.55), F(Q) is F.(9/T) re- eI = H[eIMeIOk 


peating periodically with period 27, and the DTFT of f [2k] is 3F(Q/ 2T) repeating 


. . = iD . 
periodically with period 2r. Note that F(Q/2T) is F(Q/T) time-expanded by fac- Also, according to Eq. (9.57b) with z =e", it follows that 


tor 2, as shown in Figs. 10.9b and d. If we use mth-order decimation; that is, if œ f 
we select every mth element in the sequence, the resulting decimated sequence will H [e?] = > h[k]e—7% 
be f[mk]. Using the above argument, it follows that in the fundamental frequency k=—00 


range, the DTFT of f[mk] will be 1/m times F(Q/m), and it repeats periodically 


Ob that the right-hand side of the ab tion is H (Q), the DTFT of h|k]. 
with period 2r. If m is too large, so that the first cycle of F(Q./m) goes beyond r, serve that theitightiand sideof-the above equation is H(0); the of hlk] 


Therefore 


the successive cycles of F(Q/m) will overlap, as illustrated in Fig. 10.9d. Hlei = H(Q) 
Now consider the interpolated signal f,[k] in Fig. 10.9c. This signal is f[k/2] 

(obtained by expanding f(k] by factor 2), with the alternate (missing) points filled and 

by interpolated values obtained by ideal lowpass filtering. If the envelope of f [k] ek = H(D)eIM% 


is fe(t), then the envelope of fi{k] is fe(t/2), whose Fourier transform is 2F,(2w). 
Thus, in the fundamental frequency range, the spectrum of f;[k] is 2 times F(N) 
compressed by factor 2 along the frequency axis, and periodically repeating with 
period 2r as depicted in Fig. 10.9f. Using a similar argument, we can generalize 
this result for a time-expanded signal f[k/m] with missing values filled by ideal 
interpolation. In this case, the spectrum in the fundamental frequency range will 
be m times F'(mQ) [F(Q) frequency-compressed by factor m] repeating periodically 
with period 27. 


Clearly H (N) is the LTID system frequency response. Following the argument in 
Sec. 7.1, the amplitude response of the system is |H (Q)|, and the phase response is 
Z2H(Q). We shall discuss this topic again in greater details in Chapter 12. 

Equation (10.57) states that the frequency spectrum of the output signal is the 
product of the frequency spectrum of the input signal and the frequency response 
of the system. From Eq. (10.57), we have 


IY (Q)| = IF (2) 1# (9)| (10.58) 


and 
10.5 Discrete-Time Linear System Analysis by DTFT 
ZY (Q) = LF (9) + LH (Q) (10.59) 
Consider a linear time-invariant discrete-time system with the unit impulse 


response h{k]. We shall find the (zero-state) system response y[k] for the input f [k]. This result shows that the output amplitude spectrum is the product of the input 


amplitude spectrum and the amplitude response of the system. The output phase 


Because t g 
spectrum is the sum of the input phase spectrum and the phase response of the 
[k] = fk] + hfk] (10.56) oe l ee 
We can also interpret Eq. (10.57) in terms of the frequency-domain viewpoint, 
According to Eq. (10.50a) it follows that which sees a system in terms of its frequency response (system response to various 
Y (Q) = F(Q)H(Q) (10.57) exponential or sinusoidal components). Frequency-domain views a signal as a sum 
of various exponential or sinusoidal components. Transmission of a signal through 
where F(Q), Y (N), and H(Q) are DTFTs of f[k], y[k], and h[k], respectively; that a (linear) system is viewed as transmission of various exponential or sinusoidal 
is, components of the input signal through the system. This concept can be understood 


by displaying the input-output relationships by a directed arrow as follows: 
flk] —> F(Q), yik] = Y(Q), and kfk] — > A(Q) 


; ; : 3 ef — H(M)eI% the system response to e°% is H(Q)e?%* 
This result is similar to that obtained for continuous-time systems. (9) 7 p : M) 


1 ) 
k}= = | F(Q)e®™dN shows fik f everlasti ial t 
The Frequency Response of an LTID System fik] on f (Qe shows f[k] as a sum of everlasting exponential components 
Equation (9.57a) states that the response to an everlasting exponential input and from Eq. (10.57) 


z* of an LTID system with transfer function H [z] is H[z]z*. If we let z = e, then 


1 r 
= a ne jQk r 
fHere, Fe(w) should be interpreted as the first cycle (centered at w = 0) of TFe(w) ylk] Qn f n F(Q)H (Q)e dQ  y[k] as a sum of responses to all input components 
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which is precisely the relationship in Eq. (10.57). Thus, F (Q) is the input spectrum 
and Y (Q), the output spectrum (of the exponential components), is F(Q)H(Q). 


a Example 10.7 
For a system with unit impulse response hjk} = (0.5)*u[k], determi 
= (0. , determine th 
response y(k] for the input f(k] = (0.8)*u[k]. W oe 
According to Eq. (10.57) 


Y(Q) = F(Q)H (Q) 
From the results in Eq. (10.37), we obtain 
1 e? 


F E ee S 
i) 1—0.8e-92 ei? _Q.8 


(10.60) 


A z (N) is the DTFT of (0.5)Fu[k], which is obtained from Eq. (10.37) by substituting 
~ =0.5: 


i= cs 
~ 1=0.5e92 ~ GINO 5 (10.61) 
‘Therefore 
j22 
Y) = i 
(ei? — 0.5)(e3% — 0.8) 


We can express the right-hand side as a sum of two first-order terms (modified partial 
fraction expansion as discussed in Sec. B.5-5) as follows: 


Y(Q) ei 


ei ~ (58 —0.5)(ei® — 0.8) 
5 8 


ees Ine ane eee 
ei? — 0.5 $ ei? — 0.8 


Consequently, 


Y(Q) =- (3) aoe (£) ei 


3/ ei®@—05  (3/ 2 —08 
== (3) ohn pe 1 
3/ 1~0.5e-3% (3) 1 = 0.8e-3 


According to Eq. (10.37), the inverse DTFT of this equation is 


vik] = [-$(0.5)* + 8(0.8)*] uff] 


This example demonstrates the procedure of determining an LTID system response 
using DTFT. It is similar to the method of Fourier transform in analysis of LTIC systems. 
As in the case of Fourier transform, this method can be used only if the system is asymp- 
totically stable and if the input signal is DTF-transformable. We shall not belabor this 
method further because it is clumsier and more restricted than the z-transform method 
discussed in the next chapter. In the z-transform, we generalize the frequency variable GQ 
to o + jQ so that the resulting exponentials can grow or decay with k. This procedure is 


tHere Y() is a function of variable e)®, Hence, x = ef? fi i i 
a a ae Fae for the purpose of comparison with the 
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similar to what we did in the continuous-time case by generalizing the frequency variable 
jw to s = ø + jw (from Fourier to Laplace transform) . E 


10.6 Signal processing by DFT and FFT 


In this section, we use DFT (developed in Chapter 5) as a tool, which allows 
us to utilize a digital computer for digital signal processing. This signal processing 
includes spectral analysis of digital signals and LTID system analysis. By spectral 
analysis, we mean determining the discrete time Fourier series (DTFS) of periodic 
signals and determining F(Q) from f[k] (and vice versa) for aperiodic signals. As 
a tool for LTID system analysis, DFT can be used as a software oriented solution 
to digital filtering. DFT can be implemented on a digital computer by an efficient 
algorithm, the fast Fourier transform (FFT) also discussed in Chapter 5. The DFT 
(using FFT) is truly the workhorse of modern digital signal processing. 


10.6-1 Computation of Discrete-Time Fourier Series (DTFS) 


The discrete-time Fourier series (DTFS) equations (10.8) and (10.9) are iden- 
tical to the DFT equations (5.18b) and (5.18a) within a scaling constant No. If we 
let f[k] = Nof and D, = F, in Eqs. (10.9) and (10.8), we obtain 


No-1 ‘ 
F, = > fer 
k=0 
No-1 
1 . 2n 
= —— F, jrk NQ Ap 
fk No 2 re 0= No 


This is precisely the DFT pair in Eqs. (5.18). For instance, to compute the DTFS 
for the periodic signal in Fig. 10.2a, we use the values of fx = f[k]/No as 


TTR 5 O<k<4 and 2<k<31 

e> Yo 5<k <27 
We use these values in the FFT algorithm discussed in Sec. 5.2-2 to obtain F,, 
which is the same as D,. 


10.6-2 Computation of Direct and Inverse DTFT 


Spectral analysis of digital signals requires determination of DTFT and IDTFT 
[determining F(Q) from f[k}] and vice versa]. This determination could be accom- 
plished by using the DTFT equations [Eqs. (10.30) and (10.31)| directly on a digital 
computer. However, there are two difficulties in implementation of these equations 
on a digital computer. 

1. Equation (10.31) involves summing an infinite number of terms, which is not 
possible because it requires infinite computer time. 

2. Equation (10.30) requires integration which can only be performed approxi- 
mately on a computer because a computer approximates an integral by a sum. 

The first problem can be surmounted either by restricting the analysis only to 
a finite length f[k] or by truncating f[k] by a suitable window. The error because 
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Fig. 10.10 DFT computation of a finite length signal. 


of windowing may be reduced by using a wider and a tapered window. We shall 
see that if f[k] has a finite duration, the samples of F(Q) can be computed using 
a finite sum (rather than an integral). This solves the second problem. Moreover, 
f[k] is uniquely determined from these samples of F(Q). 

In order to derive appropriate relationships, consider the signal f[k] starting 
at k = 0, and with a finite length No, as shown in Fig. 10.10a. Let us construct a 
periodic signal fy, [k] by repeating f [k] periodically at intervals of No, as illustrated 
in Fig. 10.10b. We can represent the periodic signal fNo[k] by the discrete-time 
Fourier series (DTFS) as [see Eqs. (10.8) and (10.9)] 


No~1 


j 2r 
= Dey Drek == 10.62 
fno[k] 2 e No No (10.62) 
where 
1 Nox! 
D> a. De tbe et (10.63) 
k=0 


In Eq. (10.63) we used the fact that fw [k] = f{k] for k =0, 1, 2,..., No -1. 
By definition, the DTFT of f [k] is 


No-1 
F(Q)= X flkje7% (10.64) 
k=0 


According to Eqs. (10.63) and (10.64), it follows that NoD, is F(rQ), the rth 
sample of F({). For convenience, we denote this sample by F,. Thus 


NoD, = F(rQ) = F, (10.65) 
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Therefore, NoD, are the samples of F (9) taken uniformly at the frequency intervals 
of Qo. But because No = 2r /No, there are exactly No number of these samples G 
F(Q) over the fundamental frequency interval of 2x. According to Eqs. (10.62) an 
(10.65), it follows that 


iS (10.66) 
k] = — J` Fyeit@ok 10. 
fol ] No 2 
where [from Eqs. (10.63) and (10.65)] 
No—1 
F, = D f [kJe~ 70k (10.67) 
k=0 


Because fn, [k] = f[k] for k = 0, 1, 2, ..., (No — 1), we can express the Eq. (10.66) 
as 


1 No-1 
k] = — Y> Freir Mok 
fk] = 5 > . 


Moreover, we need to determine F,, the samples of the DTFT, only over the interval 
0<2 < 2x. Therefore, Eq. (10.67) can be expressed as 


k=0,1,2,...,No-1 (10.68) 


No-1 
F, = by f [k]e 797 20k 
k=0 
Equations (10.68) and (10.69) are precisely the DFT pair derived in Eqs. (5.18a) 
and (5.18b). These equations relate F, [the samples of F(Q)] to f[k] and vice 
versa. Here F, is the DFT of f [k] and f[k] is the IDFT (inverse DFT) of Fr. This 
relationship is also denoted by the bidirectional arrow notation of a transform as 


r=0,1,2,...,No—-1 (10.69) 


fk] <=> F, 


To repeat, F,, the DFT of an No-point sequence f [k], is a set of uniform meee 
of its DIFT F(Q) taken at frequency intervals of Qo = #. The sequence f [k] 
and its DFT F, are related by Eqs. (10.68) and (10.69). Observe that there are 
No elements in f[k]. Also, there are exactly No elements in F, (over the frequency 
range 27). The DFT relationships are finite sums and can be readily computed on 
a digital computer using the efficient fast Fourier transform (FFT) algorithm. 


Properties of DFT 


We list some of the important properties of DFT proved in Chapter 5. from = 
preceding discussion, it follows that these properties of DFT also apply to DT 
samples of a finite length f [k]. 


1. Linearity: If f [k] <> F, and g[k] = G,, then 


afik] + azg|k] = a1Fr + a2G, (10.70) 
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2. Conjugate Symmetry: For real f [k] 
Fyy-r =F," (10.71) 


There is a conjugate symmetry about No/2, which enables us to determine roughly 
half the values of F, from the other half of the values, when f[k] is real. For 
instance, in a 7-point DFT, Fs = F}*, Fs = Fo" and F4 = F3*. In an 8-point DFT, 
F7 F,*, Fe Fa“, Fs F3*, and so on. 


3. Time Shifting (Circular Shifting): 


fk —n] => Fre Jon (10.72) 
4. Frequency Shifting: 
fikle <> Frm (10.73) 
5. Circular (or Periodic) Convolution: 
fik] @ glk] —> F,Gr (10.74a) 
and 
fik]glk] <=> Ai @G, (10.74b) 


where the circular (or periodic) convolution of two No-point periodic sequences f [k] 
and g[k] is defined as 


No-1i No-1 
f(e]@ oft] = $, Flnlolk— nj = $. allele - 2] (10.75) 
n=0 n=0 


Caution in Interpreting DFT and IDFT 


Equations (10.68) and (10.69) allow us to compute samples of DTFT and 
IDTFT for a finite length signal on a digital computer. To avoid certain pitfalls, 
we must understand clearly the nature of functions synthesized by the sums on the 
right-hand side of these equations. According to Eq. (10.66), it follows that the sum 
on the right-hand side of Eq. (10.68) is fnok], which is a periodic signal of which 
fk] is the first cycle. Similarly, the sum on the right-hand side of Eq. (10.69) is 
periodic. This is because F, = No D,, which is periodic. Therefore, both the DFT 
equations are periodic. We require only part of these results (over one cycle) to 
compute the samples of F(Q) from f{k] and vice versa. That is why we placed the 
restriction that k or r = 0, 1, 2, ..., No — 1 in Eqs. (10.68) and (10.69). 


Signal f[k] can start at any value of k. 


In deriving the above results, we assumed that the signal f({k] starts at k = 0. 
This restriction, fortunately, is not necessary. We now show that this procedure 
can be applied to f{k] starting at any instant. Recall that the DFT found by this 
procedure is actually the DFT of fy, [k], which is a periodic extension of f{k] with 
period No. In other words, fy,[k] can be generated from f[k] by placing f[k] and 
reproduction thereof end to end ad infinitum. Consider now the signal f[k] in 
Fig. 10.6 in which f[k] begins at k = —4. The periodic extension of this signal is 
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depicted in Fig. 10.2a for No = 32. A careful glance at this figure shows that this 
periodic signal can be constructed by any segment of length 32 and repeating it 
periodically by placing it end to end ad infinitum. We may choose a segment over 
the range k = —16 to 15 or a segment over the range k = 0 to 31, or any other 
segment of length 32. The reader should satisfy himself that the periodic extension 
of any such segment yields the same periodic signal fn,{k]. Therefore, the DFT 
corresponding to the periodic signal fy, [k] is the DFT of any of its segment of No 
length starting at any point. So the signal f [k] may start at any point. All we need 
is to construct a periodic signal f,[k] which is a periodic extension of f[k], then 
compute the DFT according to Eq. (10.68) using the sample values in the range 
k =0 to No — 1. For instance, the signal f{k] in Fig. 10.6 does not start at k = 0. 
But we can construct its periodic extension fy, (k], as shown in Fig. 10.2a, and use 
the values for k = 0, 1, 2, ..., 31 in Eq. (10.69) to compute Fy. These values are 


X 1 O<k<4 and 28<k<31 
m= 5<k<27 


Hence, according to Eq. 10.69 
No-1 


Fo = > fle =9 
k=0 


and 
Fi = e320 4 e522 4 eTo 4 eito 4. 528% 4. e7329 4 79300 4 753126 


Because No = Æ, we recognize that 5312 — ejo, e—J30M% — 52%, and so on. 
Hence 


F, = 1 + 2(cos No + cos 2N + cos 3N9 + cos 409) = 7.8865 
Note that Fo = 9 is the first sample of F (Q) , Fi = F (3) is the second sample, and 
so on. The samples are spaced 7/16 radians apart, giving a total of 32 samples in 


the fundamental frequency range. The reader may confirm these values from from 
Eq. (10.44). 


E Example 10.8 

Find the DFT of a 3-point signal f{k] illustrated in Fig. 10.11a. 

Figure 10.11a shows f [k] (solid line) and fno fk] obtained by periodic extension of f [k] 
(shown by dotted lines). In this case 


No=3 and %=— 


From Eq. (10.69), we obtain 


2 
F, = Y sie” CF) =3 42e F 4 3e7ir F 
k=0 
Therefore 
Fo =34+24+3=8 
3v3 


„2z an 3 o. 
Fy =342e 9% 43e 9% =34 (-1-jv3 TET 


<~ 
ti 
—— 
Nile 
+ 
he. 
IS 
So 
} 
ots 


-j4 jSz > 3 3v3 Lo NV3Ņ\ = 
Fz=3+2e 7% +3e oaia (E) a =e 73 
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Fig. 10.11 Computation of DFT of a signal f [k]. 


The magnitudes and angles of F, are shown in the Table below. 


Observe that Fz = Ff (the conjugate symmetry property). Because f [k] is a 3-point 
sequence, F,» (its DFT) is also a 3-point sequence, which repeats periodically. Figure 
10.11b shows F, and /F,. Recall that the DFT gives only the sample values of F(Q). We 
want to know if DFT has enough samples to give a reasonably good idea of DTFT. The 
DTFT for f{k] is given by (Eq. (10.31)] 


2 


F(Q) = > flelen9* = 3422779 4 307977 = e312 4 36) 4 3e] = 0-9 (24.6 cos N) 
k=0 


The amplitude and phase spectra are given by 


[F(Q)| = |2 + 6 cos Q| 


~Q when (2+6 2)>0 
LF (9) = { ( cos Q) 
n~-Q when (2+6 cos 2) <0 


Figure 10.11b shows |F({)| and ZF(Q) (dotted). Observe that DFT values are exactly 
equal to DTFT values at the sampling frequencies; there is no approximation. This is 
always true of DFT of a finite length f[k]. However, if f{k] is obtained by truncating or 
windowing a longer sequence, we shall see that the DFT gives only approximate sample 
values of the DTFT. 
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The DFT in this example has too few points to give a reasonable picture of the 
DTFT. The peak of DIFT appearing between the second and the third sample (between 
r = 1 and 2), for instance, is missed by the DFT. The two valleys of the DTFT are also 
missed. We definitely need more points in the DFT for an acceptable resolution. This 
goal is accomplished by zero padding, explained below. | 


Use of Zero Padding 


The DFT yields the samples of DTFT at the frequency intervals of No = 
2n/No, where Qo is the frequency resolution. Seeing the DTFT through DFT 
is like viewing F(Q) through a picket fence. Only the spectral components at 
the sampled frequencies (which are integral multiples of No) will be visible. But 
frequency components lying in between will be hidden behind the picket fence. 
If DFT has too few points, major peaks and valleys of F(Q) existing between the 
DFT points (sampled frequencies) will not be seen, thus giving an erroneous view of 
the spectrum F(Q). This is precisely the case in Example 10.8. Actually, using the 
interpolation formula, it is possible to compute any number of values of DTFT from 
the DFT. But having to use the interpolation formula really defeats the purpose of 
DFT. We therefore seek to reduce Qo so that the number of samples is increased 
for a better view of the DTFT. 

Because No = 2r/No, we can reduce No by increasing No, the length of f{k]. 
For a finite length sequence, the only way to increase No is by appending sufficient 
number of zero valued points to f[k]. This procedure of zero padding is depicted 
in Fig. 10.10c. Recall that No is the period of fx, [k], which is formed by periodic 
repetition of f[k]. By appending sufficient number of zeros to f(k], as illustrated in 
Fig. 10.10c, we can increase the period No as much as we wish, thereby increasing 
the number of points of the DFT. Recall that the number of points of both f [x] as 
well as F, are identical (No). We shall rework example 10.8 using zero padding to 
increase the number of samples of DTFT. 


E Example 10.9 

Do Example 10.8 by padding three zeros to f|[k]. 

Figure 10.12a shows the zero padded f{k]}, and the corresponding fo [k]. Now f[k] is 
a 6-point sequence. Hence, 


and from Eq. (10.69), we obtain 


5 
F, = X fike (E)E = 3 4 26°97 4 300 F 
k=0 
Therefore 
Fo =34+24+3=8 
-jz -j2z l 3 3V3 5 5v3 5% 
Fi =3+2e7343e73 = 3+ (1-jv3) + (-§- 558) = (5-238) =5e 73 


In the same way, we find 
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NO=32;k=0:N-1; 
f=[3 2 3 zeros(1,N0-3)]; 


F(Q) f Fr=fft(f) 
; r=k; 
subplot(3,1,1) 
stem(k,f); 
$ pi: ; l; iad G xlabel(’k’);ylabel(’f[k]’); 
6 4 2 01234567 6 4 2 123456 subplot (3,1,2) 
k> sa Se i eer ee stem(r,abs(Fr)) 
(a) > F 0 T F x xlabel(’r’);ylabel(’Fr’); 
subplot(3,1,3); 


stem(r,angle(Fr)) 
xlabel(’r’);ylabel(’angle Fr’);grid on; © 


osr ZF, 


E Example 10.10 

For the signal f[k] in Example 10.8, we need a frequency resolution Q = 1/6 for a 
reasonable view of F(N). Determine the number of zeros needed to be padded, and write 
the expression for computing the DFT. 

For a resolution of Qo = 7/6, the padded length No of the signal is 


~0.61x 
Fig. 10.12 DFT of a signal with zero padding. No = 2 an 2 
o= 2 r/6 
Fz=3+2e 1% 4307 — eit The padded length required is 12. Therefore we need to pad 9 zeros to f{k]. In this case 
Fs =3 42e 4.36792" 4 = 
4 Š -ir(§)k 
Fa =3+2e IF 430-98 _ -1F Fr 2r. 


Fs =3 42e 4 3e _ 5 iF 
However, the last 9 samples of f[k] are zero. Therefore, the above equation reduces to 


The magnitude and angles of F, are shown in the Table below 


2 
F, =% fikje (E) ll 
k=0 


A Exercise &10.4 

A 3-point signal f{k] is specified by f{0] = 2, f[-1] = f[l] = 1, and f{k] = 0 for all 
other k. Show that the DFT of this signal is Fo = 4, Fy = 1, and Fp = 1. Find F(Q), the 
DTFT of this signal, and verify that the DFT is equal to the samples of the DTFT at intervals of 


beens that Fs = FY and Fy = FY as expected from the conjugate symmetry 
property. Figure 10.12b shows the plots of |F-| and ZF. Observe that we now have a 6- 


point DFT, which provides 6 samples of the DTFT spaced at the frequency interval of 1/3 vo reset y 
P to 27/3 spacing in Example 10.8). The samples corresponding to r = 0, 2, A Exercise E10.5 
in Example 10.9 are identical to the samples corresponding to r = 0, 1, and 2 in Show that the 8-point DFT of the signal f[k] in Exercise E10.4 is 


Example 10.8. The DFT spectrum in Fig. 10.12b contains all the three samples appearing 
in Fig. 10.11b plus 3 more samples in between. Clearly, the zero padding allows us a better 
assessment of the DTFT. But even in this case, the valleys of the F(Q) are missed by this 


Fo = 4, F, = 3.4142, Fz = 2, Fz = 0.5858, F4 =0, Fs = 0.5858, Fs = 2, Fy = 3.4142 


(6-point) DFT. Observe the conjugate symmetry of F, about r= No/2=4. V7 
Computer E i 
© Use a ATL fi eee 10.8 to yield Practical Choice of No The value of No is determined by the desired resolution 
p: -8 to yield 32 sample values of DTFT. No. However, there is another consideration in selecting a value of No. If we are 


Because the signal length is 3 d i 
gt » We need to pad 29 zeros to the signal. using the FFT algorithm to compute the DFT, then for efficient computation of 
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{a) 4 
8-point truncated signal 
(0.8)*ulk] 
IF(Q)| for 8-point truncated 
signal (0.8) u[k] 


8-point DFT for signal (0.8)ku[k} 


Fig. 10.13 DFT computations for f[k] = (0.8)*u[k] using an 8-point rectangular window. 


DFT, No should be a power of 2. Hence, we often pad sufficient numbers of zeros 
to ensure this requirement. 


Effect of Signal truncation 


So far we have considered only finite length sequences. For such sequences, we 
can readily find the Ng-point DFT, where No is at least equal to the length of the 
sequence. How do we handle signals of infinite length? It is practically impossible to 
process infinite length sequences, because they generally require an infinite number 
of computations. Fortunately, every practical signal f [k] must decay with k (because 
of a finite energy requirement), and such signal becomes negligibly small beyond 
k 2 No for some suitable value of No. For instance, the signal f[k] = (0.6)* has 
infinite length. However, f[k] < 0.00028 at k > 16. Hence, we may truncate this 
signal beyond k = 16 (or even a little earlier). Straightforward signal truncation 
in this manner amounts to using a rectangular window with a unit weight for the 
data in the range 0 < k < No, and zero weight for the data beyond k = No. 
Such a truncation results in Gibbs phenomenon with consequent oscillations in the 
spectrum of the truncated signal as demonstrated in the following example. 


E Example 10.11 


The signal fk] = (0.8)*u{k] has infinite length. Find the DFT of this signal using an 
8-point rectangular window. 


The DTFT of this signal obtained in Eq. (10.37) is 
M2, ad ehh see 
1 ~ 0.8e-3 1.64 — 1.6cos 2 
The 8-point rectangular window function is 


1 O<k<7 
walk] = 
0 otherwise 


The windowed signal is 
(0.8) O<k<7 
for [k] = { 


otherwise 


Q > q 
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The DFT of the windowed signal is obtained using the FFT algorithm. Figure 10.13a shows 
the windowed signal and Fig. 10.13b shows the corresponding 8-point DFT. The dotted 
curve shows the DTFT amplitude |F(Q)| of the complete (untruncated) signal (0.8)Fu[k] 
for comparison. The unbroken oscillating curve is the plot of the DTFT amplitude for 
the truncated (8-point) signal. The oscillations are because of the Gibbs phenomenon 
arising from the rectangular window. Observe the interesting fact that the 8 DFT values 
computed from the truncated signal are exactly equal to the 8 samples of the DTFT of 
the complete signal. 


10.6-3 Discrete Time Filtering (Convolution) Using DFT 


The DFT is useful not only in the computation of direct and inverse Fourier 
transforms, but also in other applications such as filtering, convolution, and cor- 
relation. Use of the efficient FFT algorithm makes DFT particularly appealing. 
We generally think of filtering in terms of some hardware-oriented solution (using 
summers, multipliers, and delay elements). However, filtering also has a software- 
oriented solution {a computer algorithm that yields the filtered output y(t) for a 
given input f(t)]. Such filtering can be conveniently accomplished by using the 
DFT. 

Filtering can be accomplished either in the frequency domain or in the time 
domain. In the frequency domain approach, for a given input f [k], we are required 
to find the output y[k] of a filter with a given transfer function H (9). In the time 
domain approach, for a given input f[k], we are required to find the output y[k] of a 
filter with a given impulse response h[k]. In the time domain, the output is obtained 
by (linear) convolution of f[k] with hfk]. In the frequency domain, the output is 
obtained as an IDFT of F,H, with Fp = F (rNo) and Hr = H(r{Q). Because the 
frequency domain method appears as a substep of the time domain method, we 
shall consider here only the time domain (convolution) method. 

We would like to perform linear convolution required in filtering operation using 
DFT (utilizing FFT algorithm) because of its computational efficiency. However, 
DFT can be used to evaluate only the circular convolution, not the linear convolu- 
tion. Fortunately, linear convolution can be made equivalent to circular convolution 
by suitably padding the two sequences with zeros. This statement, introduced in 
Chapter 5, will now be proved. 


When is Linear Convolution Equivalent to Circular Convolution? 


The circular (or periodic) convolution, is explained in Sec. 5.2-1. In circular 
convolution, both sequences to be convolved are No-periodic. If f{k] and g{k] are 
both No-periodic, their periodic (or circular) convolution c[k} is defined as 


No~1t 


c[k] = fikle gik] = D> flmlalk - m] (10.76) 
m=0 


Note that the circular convolution differs from the regular (linear) convolution by 
the fact that the summation is over one period (starting at any point). In the linear 
convolution, the summation is from —oo to oo. The result of a periodic convolution 
is also an No-periodic sequence. 
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Suppose we wish to convolve two finite length sequences f [k] and h{k] of length 
Ny and Np, respectively. Let y[k] be the (linear) convolution of these sequences; 
that is, 


y[k] = f[k] + h[k] (10.77) 


From the width property of the convolution (Sec. 9.4), the length of y[k] is (Nf + 
Np — 1). Let the DTFT of the sequences F{k], h[k], and y[k] be F(Q), H(Q), and 
Y (Q), respectively. Then, from Eq. (10.50a), we have 


Y (Q) = F(Q)H (Q) (10.78) 
We know that the DFT of an No-point sequence is the set of uniform samples of its 


DTFT at frequency interval Qo = 2r /No. Therefore, if Y, is the No-point DFT of 
y(k], then 


2 
Y, = Y (rQ) Ges (10.79) 
No 
According to Eq. (10.78) it follows that 
Y, = F,H, (10.80) 


where F, and H, are the rth samples of F(Q) and H(Q), respectively. For Eq. 
(10.80) to be valid, F, and H, must be compatible for multiplication. In other 
words, both must be No-point sequences if Y, is an No-point sequence. But we 
know that f[k], h[k], and y[k] are Nf, Nn, and No = (N f+ Np- 1)-point sequences. 
Hence, we must pad N, — 1 zeros to f{k] and pad N f — 1 zeros to h[k] to ensure 
that F,, H,, and Y, are all No = (Nf + Np — 1)-point sequences. Once we compute 
F, and H, (after suitably zero-padding f [k] and h{k]), we take the IDFT of F,H, 
to obtain y[k]. However, we have shown in Chapter 5 [Eq. (5.32a)] that FH, is the 
DFT of a circular convolution of f{k] and h[k]; that is f[k] @ Alk] <> F,H,. This 
result means y[k] is equal to the circular convolution of (suitably padded) f[k] and 
hk]. Thus, y[k] is a periodic sequence whose first period is the linear convolution 
of (unpadded) f[k] and h[k]. To summarize, y(k], which is the linear convolution of 
fk] and [k], is also equal to the circular convolution of suitably padded f[k] and 
hk]. This is an extremely important result. The system response is given by the 
linear convolution of f[k] and h[k]. But the preceding result allows us to compute 
this convolution as if it were the circular convolution of (suitably padded) f{k] and 
Alk]. This, in turn, allows us to use DFT to perform the computations. 

The procedure to find the (linear) convolution of fk] and hfk], whose lengths 
are Ny and Nn, respectively, can be summarized in four steps as follows: 


1. Pad N} — 1 zeros to f[k] and Ns — 1 zeros to hfk]. 

2. Find F, and H,, the DFTs of the zero-padded sequences fik] and hfk]. 
3. Multiply F, by H, to obtain Y,. 

4. The desired convolution y[k] is the IDFT of Y,. 


Filtering In the Frequency Domain If we are given the filter transfer function 
H (N), we know H,. We compute F,, the DFT of fk]. Then follow the steps 3 and 
4 to obtain the output yf[k]. 
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h [k] (b) (e) 


0123456 4 2 0123456 


k> k—> 


> 


Fig. 10.14 Linear convolution of signals f[k] and A[k] using DFT. 


E Example 10.12 


Find y[k], the output of an LTID filter with impulse response A[k] to an input f [k] 


illustrated in Figs. 10.14a and b. 


We obtain the convolution y[k] in four steps listed above. 


1. In this case Ns = 3 and Nh = 2. Therefore, we pad 1 zero to f[k] and 2 zeros to h{k], 
as depicted in Figs. 10.14c and d, respectively. 
2. Now, No = 4 and Q = 7/2. The DFTs F, and H, of the zero-padded sequences fk] 


and h{k] are given by 


2 2 , 
F, = X fikje 7" = > fle" 2 
k=0 k=0 


=342e 93" 4379" 


1 


1 
H, = X hfk]? = Safle" 3" 


k=0 k=0 
=24+2¢753" 
Substituting r = 0, 1, 2, 3, we obtain 
= ~2; = Fy = 2 
Fo =8 Fi=-23  =4 e 
Ho=4 Hı = 2V2e794 H =0 H3 = 2/2e74 


3. Multiply F, by H, to obtain Y,. This step yields 
3n j 3x 
Yo=32 Yy=4V2e IF Yo=0 ¥3=4V2e°4 


4. The desired convolution is the IDFT of Y,, given by 


3 3 
= 29 rak 1y `Y, jr Rk 
yk] = 4 Yre “A re 


r=0 r=0 


sae : 3m 
= i (vo + Yii 2* + Yoe?™* + Yaet FE) 


654 10 Fourier Analysis of Discrete-Time Signals 


Substitution of r = 0, 1, 2, 3 in this equation yields 


yO} =6 yfl}=10 ylj=10 y[3] =6 


Figure 10.14e shows y[k] and its periodic extension (dotted). The IDFT yields the 
periodic signal. We need only the first cycle. W 


© Computer Example C10.4 
Use MATLAB to do Example 10.12. Find the answer by direct convolution as well 
as by using DFT. 
f In performing the convolution via DFT, we shall use the command fFL(F,L)’, which 
gives the FFT of a sequence f with sufficient zeros padded to make its length eaual to L. 
f=[3 2 3]; 
h=[2 2); 
L=length(f)+length(h)-1; 
k=0:1:L-1; 
% Linear convolution: Direct approach 
yl=conv(f,h); 
subplot(2,1,2) 
stem(k,y1) 
% Linear Convolution:via DFT 
FE=fft(f,L); 
HE=fft(h,L); 
y2=ifft (FE.*HE); 
subplot(2,1,1); 
stem(k,y2) © 


© Computer Example C10.5 
Use MATLAB to convolve (0.8)*u[k] and (0.5)*u(k]. Find th i 
volution and using DFT. el pe E 
Both the signals have infinite duration. Hence, we must truncate them beyond some 


suitable value of k, where both functions become negligible. For this purpose k = 32 is a 
reasonable choice. 


R=32; 

m=0:1:R-1; 

f=(0.8).°m; 

h=(0.5).7m; 
L=length(f)+length(h)-1; 
k=0:1:L-1; 

% Linear convolution: Direct approach 
yl=conv(f,h); 

subplot(2,1,2) 

stem(k,y1) 

% Linear Convolution:via DFT 
FE=fft(£,L); 

HE=fft(h,L); 

y2=ifft (FE.*HE); 

k=0:1:L-1; 
subplot(2,1,1);stem(k,y2) 
stem(k,y2) © 
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A Exercise E10.6 

Show that the circular convolution of two 3-point sequences 3, 2, 3, and 1, 2, 3 , (both 
starting at k = 0) is also a 3-point sequence 15, 17, 16. Find the answer by using DFT, and 
verify your answer using the graphical method explained in Fig. 5.17. Using the sliding tape 
method (Fig. 9.4), show that the linear convolution of these sequences is a 5-point sequence 
3, 8, 16, 12, 9. Indicate how you will obtain the linear convolution of these two sequences using 


circular convolution. 7 


A Exercise E10.7 

The input f[k] of an LTID system is a 4-point sequence 1, 1, 1, 1, and hfk), the impulse 
response of the system, is a 3-point sequence 1, 2, 1. Both sequences start at k = 0. Using DFT, 
show that the output y[k] is a 6-point sequence 1, 3, 4, 4, 3, 1 starting at k = 0. Verify your 
answer by deriving the output as a linear convolution of the two sequences using the sliding tape 
method. Yy 


Efficacy of DFT in Convolution Computation 


Using the sliding tape algorithm discussed in Chapter 9, we can perform the 
convolution in Example 10.12 with a mere 6 (real) multiplications and 2 additions. 
The DFT method discussed in this section appears much too laborious, and the 
use of DFT for convolution may seem questionable. Recall, however, our discussion 
in Sec. 5.3, which showed that the use of FFT algorithm to compute DFT reduces 
the number of computations dramatically, especially for large No. For small length 
sequences, the direct convolution method, such as the sliding tape method is faster 
than the DFT method. But for long sequences, the DFT method using the FFT 
algorithm is much faster and far more efficient. The method of finding convolution 
using the fast Fourier transform (FFT) is known as the fast convolution. 


Block Filtering or Convolution 


In practice, the length of an input signal may be very large, whereas a computer 
processing such a signal may have a limited memory. To process such long sequences, 
we can section the input signal into blocks of a length small enough to be processed 
by a given computer, and then add the outputs resulting from all the input blocks. 
This procedure can be used because the operation is linear. Such a procedure would 
be desirable even if the processing computer had an unlimited memory. For longer 
inputs, we must wait a long time before the input is fed to the computer (before 
it even starts processing), and then an even longer time for processing the large 
amount of data. Consequently, there is a long delay in the output. Sectioning the 
input allows the output to have a smaller processing delay. We shall now discuss 
two such method of block processing, overlap and add method and overlap and 
save method. Either of the methods requires the same number of computations, 
hence, which method is used is a matter of choice. 


Overlap and Add Method 


Consider a filtering operation, where the output y[k] is the convolution of the 
input f{k] and a FIR filter impulse response Ak] of length M. In practice, usually 


tlt can be shown that in convolution of two sequences, each of length No, the number of com- 
putations required is on the order of Ne, whereas for DFT, using FFT algorithm, the number of 


computations required is only on the order of No log; No. 
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Fig. 10.15 Overlap and add method of block filtering. 


M is much smaller than the length of the input. Figure 10.15 illustrates a long 
input sequence sectioned into nonoverlapping blocks of a manageable length L. 
The number inside each block indicates its length. Let us assume that L > M. We 
now process each block of the input data in sequence. To be able to use the circular 
convolution for performing the linear convolution, we need to pad M — 1 zeros at 
the end of each data block.{ Figure 10.15 shows each data block augmented by 
M — 1 zeros. The augmented portion of the block is shown shaded. Observe that 
the augmented (zero-padded) blocks of the input, each of length L + M — 1, now 
overlap. 

The output sequence corresponding to each block also has a length L + M — 1 
(recall that the length of the circular convolution of two sequences, each of length 
L+M —1, is also L+M —1). The output sequences, therefore, also overlap, as shown 
in Fig. 10.15. The total output is given by the sum of all these overlapping output 
blocks of length L + M — 1. The contents of the two successive blocks are added 
wherever they overlap. This method is known as the overlap and add method. 


W Example 10.13 

Using overlap and add method of block filtering, find the response y[k] of an LTID 
system, whose impulse response A[k] and the input f[k] are shown in Fig. 10.16. 

The output y[k] is a linear convolution of f[k] and A[k]. Let us use L = 3 for the 
block convolution. Also M = 2. Hence, we need to break the input sequence in blocks of 
3 digits and pad each block with M — 1 = 1 zero, as depicted in Fig. 10.16. We convolve 
each of these blocks with A[k] using DFT, as demonstrated in Example 10.11. 

In this case, No = 4 and Qo = 2/4. The DFTs F, and H, of the zero-padded 
sequences f[(k] and A[k] are given by 


Es 1 
Fe= Ñ fiket and m= alee? 
k=0 k=0 


TWe also pad h{k] with L — 1 zeros so that the length of the padded h[k] is L + M — 1. 


012345678 


> 


v 
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Fig. 10.16 An Example of overlap and add method of block filtering. 


Also, Y- = F,H». We compute the values of Fy, Hr, and Y, using these equations for each 


block: 
For the first block, 


F, =34+2e 98 43e, 9 Hp = 242093" and  Yp= F-H, 


Also a 
(Yo + Yi ei F* + Ye27* + Y3e? 2 J 


mie 


3 
1 irk 
yik] = 4 X Ype’ P 


r=0 


Substituting r = 0, 1, 2, 3, we obtain 


j = Fs = 2j 
Fo =8 Fy=-2j Fo=4 a x 
Ho =4 Hy = 2V 2e i H2=0 H; = 2V2 k 
Yo = 32 Yı = 4Vae FF Yo =0 Y3 = AVe i 
y(0] = 6 y[1] = 10 y[2] = 10 y[3] = 6 


Using the same procedure for the second block, we obtain 
yo} =2, yllJ=2 yf2]=2, ys] =2 
For the third block, we obtain 


yol=0, yfJ=2 yl2J=4, yls}=2 


Figure 10.16 shows the overlapping input and output blocks, and the convolution sequence 


obtained by adding the output blocks. 
The procedure using DFT given here is much more laborious than the direct con- 


volution by the sliding tape method (Sec. 9.4). The reason is that we did not use a 
algorithm to compute DFT here. In this example, with a rather small No, even FFT wi 
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Output blocks 


Discard No. | 


Fig. 10.17 Overlap and Save method of block filtering. 


have more number of computations than the direct convolution. In practice, we generally 
deal with much larger values of No, where use of DFT (utilizing FFT algorithm) pays 
off. It will be informative for the reader to find linear convolution (using the sliding tape 
method) of one unpadded data block with unpadded A[k]. Next, find the circular convo- 
lution of the same data block padded with 1 zero and h{k] padded with 2 zeros. Use the 
graphical method of circular convolution illustrated in Fig. 5.17. Verify that you get the 
same answer in both cases. W 


Overlap and Save Method 


In the overlap and save method also, the input sequence is sectioned into 
nonoverlapping blocks of a manageable length L. As before, each block is aug- 
mented with M — 1 data points. But unlike the previous method, this method 
places augmented points at the beginning of each block. The augmented M — 1 
data points of a block are the same as the last M — 1 points of the previous block 
so that the last M — 1 data points of each block also appear as the first M — 1 
data points of the succeeding block. The exception is the first block, where the first 
M — 1 data points are taken as zeros, as shown in Fig. 10.17. We now convolve 
each of these blocks with h[k] (padded by L — 1 zeros). As before, DFT is used to 
perform convolution. 

The output sequence corresponding to each block also has a length L +M —1. 
We discard the first M — 1 data points and save the last L data points from each 
output block, as depicted in Fig. 10.17. The total output is given by combining 
all the saved blocks in sequence. This method is known as the overlap and save 
method. More details of this method can be found in the literature.! 


| Example 10.14 


Using overlap and save method of block filtering, find the response y[k] of an LTID 
system, whose impulse response h[k] and the input are illustrated in Fig. 10.16. 


10.7 Generalization of the DTFT to the z-transform 


659 


oms KO ENED 


-e opa 


Discard 


ee 
roa ove [6 Tro[ of sf 2]2]2]2 lel" 


Fig. 10.18 An Example of overlap and save method of block filtering. 


We follow the procedure given in Fig. 10.17 to section the input data as shown 7 
Fig. 10.18. Note that the first M — 1 = 1 data point of the first block is padded era 
the last M — 1 = 1 point of each block also appears as the first point of the ee se 
Each block of length L — M +1 = 4 is now convolved (using DFT) with A[k] = ye 
two zeros). The DFT procedure is already explained in Example 10.13. We sh: ee ied 
details here. the resulting output blocks are depicted in Fig. 10.18. The first M ah F 
point of each output block is discarded. The total output is given by combining e 


saved blocks in sequence. a 


Computer Example C10.6 
9 Use MATLAB to do example 10.13 (overlap and add method). ; f 
Here, we use the MATLAB command ’fitfilt(h,f,M)’ to perform convolution pe 
overlap and add method with blocks of length M. This m-file is available in Signal Pro- 


cessing Toolbox. 


f=(3 2310101 1); 
h=[2 2]; 
L=length(f)+length(h)-1; 
k=0:1:L-2; 
y=fftfilt(h,f,3); 
stem(k,real(y)); © 


A Exercise E10.8 
The input f{k] of an LTID system is a sequence 1, 0, —1, 2, ..., and hfk), thie A 

response of the system is a 3-point sequence 3, 2, 3. Both sequences start at k = 0. Using a 

convolution with L = 2, show that the output is 3, 2, 0, 4, .... Derive your answer using bo 


methods of block filtering. Y 


10.7 Generalization of the DTFT to the Z-Transform 


LTID systems can be analyzed using DTFT. This method, however, has the 


following limitations: l 
1. Existence of the DTFT is guaranteed only for absolutely summable signals [see 
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Eq. (10.36)]. The DTFT does not exist for exponentially growing signals. This 
means the DTFT method can be applied only for a limited class of inputs. 


2. Moreover, this method can be applied only to asymptotically stable systems; 
it cannot be used for unstable or even marginally stable systems. 


These are serious limitations in the study of LTID system analysis. Actually it 
is the first limitation that is also the cause of the second limitation. Because DIFT 
is incapable of handling growing signals, it is incapable of handling unstable or 
marginally stable systems.t Our goal is, therefore, to extend the concept of DTFT 
so that it can handle exponentially growing signals. 

We may wonder what causes this limitation on DTFT so that it is incapable of 
handling exponentially growing signals. Recall that in DTFT, we are synthesizing 
an arbitrary signal f{k] using sinusoids or exponentials of the form eJk These 
signals are sinusoids with constant amplitudes. They are incapable of synthesizing 
exponentially growing signals no matter how many such components we add. Our 
hope, therefore, lies in trying to synthesize f[k] using exponentially growing sinu- 
soids or exponentials. This goal can be accomplished by generalizing the frequency 
variable jQ to o + jQ; that is, by using exponentials of the form e(°+52) instead 
of exponentials eł?. The procedure is almost identical to that used in extending 
the Fourier transform to the Laplace transform in Sec. 6.1. The intuitive argument 
is identical to that discussed in Sec. 6.1, and the reader may wish to review it to 
refresh his memory. Here we shall go straight to the analytical development. 

As in the case of Fourier to Laplace, it is desirable to use the notation F (jN) 
instead of F(N) for the DTFT in order to unify the DTFT and the generalized 
transform (z-transform). Thus, 


F(jQ) = > fik] e719" (10.81) 
k=—00 
and m 
lk] = > F(jQ) e19 da (10.82) 


=F. 


Consider now the DTFT of f{k]e~°* (a real ) 


DTFT [f[k]e~*] = XO fl] e e72 (10.83) 
k=~co 

=) ifeje ee (10.84) 
k=- 


It follows from Eq. (10.81) that the above sum is F (ø + jQ). Thus 


DTFT [f [k] e~7*] = D flk]e7 CFIME = F(o +52) (10.85) 


k=—00 


{Recall that the output of an unstable system grows exponentially. Also, the output of a marginally 
stable system to characteristic mode input grows with time. 
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Fig. 10.19 Contour of integration for the z-transform. 
Hence, the inverse DTFT of F(a + j9) is f[k] e77 k. Therefore 
1 f , 
flkle"7* = aa F(a + j9) 2 dN (10.86) 
N Jan 


Multiplying both sides of the above equation by eF yields 
1) of . 
f= 5 / F(o + 5) e0 +I aQ (10.87) 
N Jan 
Let us define a new variable z as 


F 1 
z = e7ti2 so that Inz =o +52 and z dz = j dQ (10.88) 


Because z = e7t3® is complex, we can express it as z =T eJ®, where r = e7. Thus, 
z lies on a circle of radius r, and as Q varies from —r to 7, z circumambulates 
along this circle, completing exactly one rotation in counterclockwise direction, as 
illustrated in Fig. 10.19. Changing to variable z in Eq. (10.87) yields 


fik] = 5 f F(inz) z*71 dz (10.89a) 


and from Eq. (10.85) we obtain 
o0 
F(Inz)= $. fik] (10.89b) 
k=—00 


where the integral $ indicates a contour integral around a circle of radius r in 
counterclockwise direction. 

The above two equations are the desired extensions. They are, however, in a 
clumsy form. For the sake of convenience, we make a notational change by noting 
that F (Inz) is a function of z. Let us denote it by a simpler notation F{z|. Thus, 
Eqs. (10.89) become 


fik] = z frt z5! dz (10.90) 
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and 
oo 
Fl] = X. fik] (10.91) 
k=—00 


This is the (bilateral) z-transform pair. Equation (10.90) expresses f [k] as a contin- 
uous sum of exponentials of the form z* = e(¢+j%)k — pk 38k Thus, by selecting 
a proper value for r (or ø), we can make the exponential grow (or decay) at any 
exponential rate we desire. 

If we let ø = 0, we have z = ef? and 


F(z] = F(Inz) = F(jQ) = F(Q) (10.92) 


Thus, the familiar DTFT is just a special case of the z-transform F[z] obtained by 
letting z = ef? 


10.8 Summary 


This chapter deals with analysis and processing of discrete-time signals. For 
analysis, our approach is parallel to that used in continuous-time signals. We first 
represent a periodic f[k] as a Fourier series formed by a discrete-time exponential 
and its harmonics. Later we extend this representation to an aperiodic signal f [k] 
by considering f{k] as a limiting case of a periodic signal with period approaching 
infinity. Periodic signals are represented by discrete-time Fourier series (DTFS); 
aperiodic signals are represented by the discrete-time Fourier transform (DTFT). 
The development, although similar to that of continuous-time signals, also reveals 
some significant differences. The basic difference in the two cases arises because 
a continuous-time exponential e?“* has a unique waveform for every value of w in 
the range —oo to oo. In contrast, a discrete-time exponential e/* has a unique 
waveform only for values of Q in a continuous interval of 2r. Therefore, if Qo is 
the fundamental frequency, then at most pa number of exponentials in the Fourier 
series are independent. Consequently, the discrete-time exponential Fourier series 
has only No = # terms. 

The discrete-time Fourier transform (DTFT) of an aperiodic signal is a contin- 
uous function of Q and is periodic with period 2x. We can synthesize F (Q) from 
its spectral components in any band of width 2r. Linear time-invariant discrete- 
time (LTID) systems can be analyzed using DTFT if the input signals are DTF- 
transformable and if the system is stable. Analysis of unstable (or marginally sta- 
ble) systems and/or exponentially growing inputs can be performed by z-transform, 
which is a generalized DTFT. The relationship of DTFT to z-transform is similar to 
that of the Fourier transform to the Laplace transform. Whereas the z-transform 
is superior to DTFT for analysis of LTID systems, DTFT is preferable in signal 
analysis. 

If H (Q) is the DTFT of the system’s impulse response hjk], then |H (Q)] is the 
amplitude response, and ZH (Q) is the phase response of the system. Moreover, 
if F(Q) and Y(Q) are the DIFTs of the input f [k] and the corresponding output 
ylk], then Y (9) = H(Q)F(Q). Therefore the output spectrum is the product of the 
input spectrum and the system’s frequency response. 

The numerical computations in modern digital signal processing can be conve- 
niently performed with the discrete Fourier transform (DFT) introduced in Chapter 
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5. The DFT computations can be very efficiently executed by using the fast Fourier 
transform (FFT) algorithm. The DFT is indeed the workhorse of modern digital 
signal processing. The discrete-time Fourier transform (DTFT) and the inverse 
discrete-time Fourier transform (IDTFT) can be computed using the DFT. For an 
No-point signal f{k], its DFT yields exactly No samples of F(Q) at frequency in- 
tervals of 2x/No. We can obtain a larger number of samples of F(Q) by padding 
sufficient number of zero valued samples to f{k]. The No-point DFT of f[k] gives 
exact values of the DIFT samples if f[k] has a finite length No. If the length of 
fk] is infinite, we need to truncate f[k] using the appropriate window function. 

Because of the convolution property, we can compute convolution of two signals 
f|k] and A[k] using DFT. For this purpose, we need to pad both the signals by a 
suitable number of zeros so as to make the linear convolution of the two signals 
identical to the circular (or periodic) convolution of the padded signals. Large blocks 
of data may be processed by sectioning the data into smaller blocks and processing 
such smaller blocks in sequence. Such a procedure requires smaller memory and 
reduces the processing time. 
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Problems 


10.1-1 Find the discrete-time Fourier series (DTFS) and sketch their spectra |D,| and LD, 


for 0 < r < No — 1 for the following periodic signal: 
fk] = 4cos 2.4rk + 2sin 3.2rk 


Hint: Reduce frequencies to the fundamental range (0 < 2 < 2r). The fundamental 
frequency Qo is the largest number of which the frequencies appearing in the Fourier 
series are integral multiples. 


10.1-2 Repeat Prob. 10.1-1 if f[k] = cos 2.2rk cos 3.37k. 
10.1-3 Repeat Prob. 10.1-1 if f[k] = 2cos 3.2r(k — 3). 


fiki 


Fig. P10.1-4 


10.1-4 Find the discrete-time Fourier series and the corresponding amplitude and phase 


spectra for the f[k] shown in Fig. P10.1-4. 


10.1-5 
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Repeat Prob. 10.1-4 for the f[k] depicted in Fig. P10.1-5. 


10.1-6 Repeat Prob. 10.1-4 for the f{k] iNustrated in Fig. P10.1-6. 


10.1-7 A signal f[k] 


10.1-8 


JEK] 


Fig. P10.1-5 


Fig. P10.1-6 


is approximated i A l 
k < N1) as PP. in terms of another signal z[k] over an interval (Ni < 


S[k] ~ czfk] 


(a) Show that for the best a imati 
: Pproximation that minimizes th 
signal e[k] = f[k] — c[k] over the same interval oe Tae 


Ni Sks Ne 


Nz 
c= a D. sike’) 
k: 


=N; 


(b) If c = 0, the discrete-time signals f[k] and z[k] 


the interval (Ni < k < N2). Use this observation 
discrete-time signals. 


(c) Show that the set of signals e770 
over an interval (0 < k < No — 1). Hence 
using the result in part (a). 

Hint: Recall that if w is complex, then |w|? 


are said to be orthogonal over 
to define the orthogonality of 


, find the exponential Fourier series (DTFS) 


=ww". 
An No-periodic signal f[k] is re i 

presented by its DTFS as i 
val’s theorem (for DTFS), which states that wae 


m È s= So pp 


k=<No> r=<No> 


q. (10.8). Prove Parse- 


Earlier (Eq. (10.51)], we obtained the Pareseval’s theorem for DTFT 
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Problems id 


10.2-1 


10.2-2 


10.2-3 
10.3-1 


10.3-2 


10.4-1 


10.5-1 


10.5-2 


10.5-3 


10.6-1 


Hint: If w is complex, then |w|? = ww*, and use Eq. (5.43). 

For the following signals, find the DTFT directly, using the definition in Eq. (10.31). 
(a) f[k] = 6[k] (b) d[k— ko] (c) a*ulk—1] Jaf <i 

(d) fik] =a*ulfk+1) el <1. 

In each case, sketch the signal and its amplitude spectrum. Sketch phase spectra for 
parts (a) and (b) only. 

Find the DTFT for the signals shown in Fig. P8.2-9 (Chapter 8). 


Fig. P10.2-3 


Find the inverse DTFT for the spectrum depicted in Fig. P10.2-3. 


Using the time-shifting property and the results in Examples 10.3 and 10.5, find the 
DTFT of (a) a*{ufk] — ufk — 10]} (b) ulk] — u[k — 9]. 

Using appropriate properties and the result in Example 10.3, find the DTFT of (a) 
(k + 1)a*ulk] (lal < 1) (b) a" cos Nok ufk]. 

For the spectrum F(Q) in Fig. P10.2-3 

(a) Find and sketch its IDTFT f[k]. 

(b) Sketch f [2k], f[4k], and find their DTFTs. 

(c) Sketch f[k/2] and fill in the alternate missing samples using ideal interpolation 
(upsampling by a factor 2). Find the DTFT of the resulting interpolated (upsampled) 
signal f:[k}. 

Using the DTFT method, find the zero-state response y[k] of a causal system with 


frequency response : 
ei? + 0.32 


H(Q) = Say ei + 0.16 


and the input 
fik] = (—0.5)* ula] 


Repeat Prob. 10.5-1 if a 
ef — 0.5 
AM = (ei + 0.5)(e3% — 1) 
and 
fik] = 3° Pula 


Repeat Prob. 10.5-1 if 


and 
S[k] = 0.8" u[k] + 2(2)*uf~(k + 1)] 


Find the DFT of a 3-point signal f[k] specified by f[—1] = f[0] = 3, f[1] = 2 and 
fik] = 0 otherwise. Now determine F(Q), the DTFT of f{k], and verify that DFT 
values are the samples of F(Q). 
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10.6-2 


10.6-3 


10.6-4 


10.6-5 
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(b) Show that the 3-point DFT of this signal is identical to that of the signal f[k] in 
Fig. 10.11a. Can you explain why? Does this mean the DTFTs of the two signals are 
also identical? Determine the DTFTs of the two signals and see if they are identical 
(for all values of 9). 


(c) Find the 8-point DFT of f{k]. 


(a) Find the 4-point and 8-point DFT of a 4point signal specified by the sequence 
1, 2, 2, 1 starting at k = 0. 


(b) Find F(Q), the DTFT of f[k], and verify the DFT values from F(Q). 


(a)Find the DFT of the signal f[k] = 6[k]. Find also F(Q), the DTFT of 6[k], and 
verify the DFT values from F(Q). Note that this is a 1-point signal (No = 1). 


(b) Show that the DFT of f[k] = 6[k — m] is the same as the DFT of 6[k] for any 
integral value of m. Explain this behavior. 


(c) Repeat part (a) for the No-point DFT (found by padding No — 1 zeros to 6[k]). 
Explain this DFT from F(Q) found in part (a). 


(a) Find the DFT of the No-point signal f[k] = u{k] — u[k — No]. Find F(Q), the 
DTFT of f[k] and verify that the DFT values are the uniform samples of DTFT at 
frequency intervals of No = 2m/No. 


(b) Is the DTFT found in part (a) an adequate frequency-domain description of fk}. 
If not, what needs to be done to obtain a reasonably adequate DFT? 


(a) Find the 5-point and 8-point DFT of the signal f [k] illustrated in Fig. P8.2-9d. 
(b) Find F(Q), the DTFT of f[k], and verify the DFT values from F(Q). 


fik g [k] 


10.6-6 


lithe tothe 


Fig. P10.6-6 


(a) Using the graphical method shown in Fig. 5.17, find the circular convolution of 
the sequences f[k] and g[k], depicted in Fig. P10.6-6. 

(b) Using the sliding tape method (Fig. 9.4), find the linear convolution of the first 
cycles (over the range 0 < k < 3) of the sequences f[k] and g[k]. Is the result same 
as that found in part (a)? 

(c) The circular convolution can be made equivalent to the linear convolution by 
suitably padding (the first cycle of) the sequences f [k] and g[k] with zeros. How many 
zeros do you need to pad to f[k] and A{k]? After suitably padding these sequences, 
perform the circular convolution using the graphical method illustrated in Fig. 5.17, 
and show that it is equivalent to the linear convolution found in part (b). 


(d) Find the circular convolution of f{k] and g{k] obtained in part (a) using DFT. 
(e) Find the linear convolution of f[k] and g{k] obtained in part (b) using DFT. 
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hik , 
2 
1- 

k 


0123 a 


fik P 
24 
14 

k— 


0123 
Fig. P10.6-7 


10.6-7 Find the output of a system with impulse response h[k] and the input f[k] shown in 
Fig. P10.6-7 by the following methods: (i)using linear convolution of f[k] and g[k] by 
sliding tape method (ii) using circular convolution of suitably padded f{k] and g[k] 
using the graphical method, depicted in Fig. 5.17 (iii) using DFT. 


sA, h 
ie i 
E 1 


0123 > 0123 oe 
Fig. P10.6-8 


Fig. P10.6-9 


10.6-8 (a) Repeat Prob. 10.6-7 for the signals f({k] and A[k] illustrated in Fig. P10.6-8. 

10.6-9 Using both the methods of block filtering (overlap and add, and overlap and save), 
find the output of a filter with impulse response hA[k] and the input f[k] shown in 
Fig. P10.6-9. Take L = 3. Verify that the linear convolution of the input sequence 
fik] = {1, -2, 3, 0, —1, 2,...} with h[k] = {2, 2} gives the same output as that 
found by the block filtering methods. 


10.6-10 Find the 16-point IDFT of F(Q) in Fig. 10.7a. Do the values of IDFT agree with the 
values of f[k] found in Eq. 10.45. If not, why not? 


Discrete-Time System Analysis 
Using the Z-Transform 


The counterpart of the Laplace transform for discrete-time systems is the z- 
transform. The Laplace transform converts integro-differential equations into alge- 
braic equations. In the same way, the z-transforms changes difference equations into 
algebraic equations, thereby simplifying the analysis of discrete-time systems. The 
z-transform method of analysis of discrete-time systems parallels the Laplace trans- 
form method of analysis of continuous-time systems, with some minor differences. 
In fact, we shall see that the z-transform is the Laplace transform in disguise. 

The behavior of discrete-time systems (with some differences) is similar to 
that of continuous-time systems. The frequency-domain analysis of discrete-time 
systems is based on the fact (proved in Sec. 9.4-2) that the response of a linear 
time-invariant discrete-time (LTID) system to an everlasting exponential z* is also 
the same exponential (within a multiplicative constant), given by H[z]z*. We then 
express an input f[k] as a sum of (everlasting) exponentials of the form z*. The 
system response to f[k] is then found as a sum of the system’s responses to all these 
exponential components. The tool which allows us to represent an arbitrary input 
f{k] as a sum of (everlasting) exponentials of the form z* is the z-transform. 


11.1 The Z-Transform 


In the last Chapter, we extended the discrete-time Fourier transform to derive 
the pair of equations defining the z-transform as 


Fz] = J. fikle-* (11.1) 
k=- 

fik] = zg fre dz (11.2) 
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where the symbol $ indicates an integration in counterclockwise direction around 
a closed path in the complex plane (see Fig. 11.1). As in the case of the Laplace 
transform, we need not worry about this integral at this point because inverse z- 
transforms of many signals of engineering interest can be found in a z-transform 
Table. The direct and inverse z-transforms can be expressed symbolically as 


Flz]=Z{flk]} and — ffik]=2 {F[z]} 


or simply as 
fik] <= Fiz] 


Note that 
Z- [Z{f[k]}] = fik] and = 2 [27 {F[z}}] = Fle] 


Following the earlier argument, we can find an LTID system response to an 
input f(k] using the steps as follows: 


zk = H [z]z* the system response to z* is H[z]z* 


fik) = = f F [z]z*-? dz shows f[k] as a sum of everlasting exponential components 
TJ 


and 
y[k] = ae f F|z]H [z]z¥7*dz shows y{k] as a sum of responses to exponential components 
2rj 
= L, fri dz 
2rj 
where 


Y [2] = F[z]H [z] 


In conclusion, we have shown that for an LTID system with transfer function H [z], 
if the input and the output are f[k] and y[k}, respectively, and if 


fk] <> Fẹ] sk] & Yi] 


then 
Y [z] = F [z]H [z] 


We shall derive this result more formally later. 
Linearity of the Z-Transform 
Like the Laplace transform, the z-transform is a linear operator. If 
filk] < F,[z] and folk] = Fəf[z] 


then 
afi [k] + azf2lk} = a1F4[z] + a2Fo[z] (11.3) 


670 11 Discrete-Time Systems Analysis Using the Z-Transform 


The proof is trivial and follows from the definition i 
of the z-transform. Th 
can be extended to finite sums. 7 nog 


The Unilateral Z-Transform 


For the same reasons discussed in Chapter 6, we first start with a simpler 
version of the z-transform, the unilateral z-transform, that is restricted only to 
the analysis of causal systems with causal inputs (signals starting at k = 0). The 
more general bilateral z-transform is discussed later in Sec. 11.7. In the unilateral 
case, the signals are restricted to be causal; that is, they start at k = 0. The 
definition of the unilateral transform is the same as that of the bilateral [Eq (11 1)] 
except that the limits of the sum are from 0 to co ase 


F(z] = X fik] (11.4) 
k=0 


where z is complex in general. The expression for the inverse z-transform in Eq. 
(11.2) remains valid for the unilateral case also. 


The Region of Convergence of F[z| 


The sum in Eq. (11.1) [or (11.4)] defining the direct z-transform F[z] may not 
converge (exist) for all values of z. The values of z (the region in the complex 
plane) for which the sum in Eq. (11.1) converges (or exists) is called the region of 
convergence (or region of existence) of F{z]. This concept will become clear in 
the following example. 


E Example 11.1 
ar ao the z-transform and the corresponding region of convergence for the signal 
By definition 
oo 
F[z] = So ujk] 
k=0 


Since u[k] = 1 for all k > 0, 


rl= 9° (2) 


k=0 
= 7 r O 
=1 a £ a wae GS T 
+(2)+(2) +) 40-4 (11.5) 
It is helpful to remember the following well-known geometric progression and its sum: 
14+ S ie i 
ate +a + = if |z)<1 (11.6) 


Use of Eq. (11.6) in Eq. (11.5) yields 


Fiz] = —~ |z| <1 


lz] > ltl (11.7) 


11.1 The Z-Transform 671 


Fig. 11.1 y*u{k] and the region of convergence of its z-transform. 


Observe that F[z] exists only for |z| > |y|. For |z| < Jy], the sum in Eq. (11.5) does not 
converge; it goes to infinity. Therefore, the region of convergence (or existence) of F [z] is 
the shaded region outside the circle of radius \y|, centered at the origin, in the z-plane, as 
depicted in Fig. 11.1b. Ml 


The region of convergence is required for evaluating f [k] from F [z], according to 
Eq. (11.2). The integral in Eq. (11.2) is a contour integral implying integration in a 
counterclockwise direction along a closed path centered at the origin and satisfying 
the condition |z| > |y]. Thus, any circular path centered at the origin and with a 
radius greater than |y| (Fig. 11.1b) will suffice. We can show that the integral in Eq. 
(11.2) along any such path (with a radius greater than |7|) yields the same result, 
namely fk]. Such integration in the complex plane requires a background in the 
theory of functions of complex variables. We can avoid this integration by compiling 
a table of z-transforms (Table 11.1), where z-transform pairs are tabulated for a 
variety of signals. To find the inverse z-transform of say, z/(z — y), instead of 
using the complex integration in (11.2), we consult the table and find the inverse 
z-transform of z/(z — 7) as y*u{k]. Although the table given here is rather short, 
it comprises the functions of most practical interest. 

The bilateral z-transform is defined by Eq. (11.1) with the limits of the right- 
hand sum from —oo to oo instead of from 0 to oo. The situation of the z-transform 
regarding the uniqueness of the inverse transform is parallel to that of the Laplace 
transform. For the bilateral case, the inverse z-transform is not unique unless the 
region of convergence is specified. For the unilateral case, the inverse transform is 
unique; the region of convergence need not be specified to determine the inverse z- 
transform. For this reason, we shall ignore the region of convergence in the unilateral 
z-transform Table 11.1. 


Existence of the Z-Transform 


By definition 


F[z] = So fik] = 5; mi 
k=0 k=0 
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The existence of the z-transform is guaranteed if 


|F iz]| < 5 If [k] < œ 
k=0 


lz|* 


for some |z]. Any signal f[k] that grows no faster than an exponential signal ro* 
for some ro, satisfies this condition. Thus, if , 


IfTE]L < ro” for some ro (11.8) 


then 
co k 
relsD(B) sig H> 


Therefore, F(z] exists for |z| > ro. All practical signals satisfy (11.8) and are 
therefore z-transformable. Some signal models (e.g. y) which grow faster than 
the exponential signal ro* (for any ro) do not satisfy (11.8) and therefore are not z- 
transformable. Fortunately, such signals are of little practical or theoretical interest. 


@ Example 11.2 
ay Find the z-transforms of (a) 6[k] (b) u[k] (c) cos Bk ul[k] (d) signal shown in Fig. 
Recall that by definition 


Fiz] = X flkle* 
k=0 


=por 4 81, A. (11.9) 
(a) For f[k] = 6[k], f[0] = 1 and f[2] = f(3] = f[4] =--- = 0. Therefore 

6[k] <> 1 for all z (11.10) 
(b) For f[k} = ufk], f[0] = f[1] = f[3] =--- = 1. Therefore 


1,11 
Fil =1+-+5 tt 
z Z z 


From Eq. (11.6) it follows that 


1 
F= |] <1 
we z 
z 
z 
Sai jz] >1 
Therefore 
z 
ufk] => Ea |z| >1 (11.11) 


(c) Recall that cos Bk = (PF + e7iPE) /2. Moreover, according to Eq. (11.7), 


458k aa +458 
e ulk] = oE |z| > |e?" } =1 
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Therefore 
1 z z 
Fi) =3 |5 end <= | 
z(z — cos £) 
~ 22—2zcos B+1 z> 1 
(a) Here f[o] = f(t] = £12] = 13] = fl4] = 1 and f5] = f[6] = --- = 0. Therefore, 


according to Eq. (11.9) 


1 1 1 1 
A tee hoe oA 


F[z] 


zi¢2342%7 4241 
74 


We can also express this result in a closed form by summing the geometric progression 
on the right-hand side of the above equation, using the formula in Sec. B.7-4. Here the 
common ratio r = i, M =0, and N = 4, so that 


1y5 _ (2)0 z 
ri = 2) =>0-7°) E 


fk) 


7 8 9 


Fig. 11.2 Fig. 11.3 


A Exercise E11.1 
(a) Find the z-transform of a signal shown in Fig. 11.3. (b) Using Pair 12a (Table 11.1) find 
the z-transform of f{k] = 20.65(/2)* cos (žk = 1.415) uk]. 


54 z4 34 2 
Answers tS HS z” +z Li ta +z+1 ope (a4 2710) 
z g= 


z(3.2z + 17.2) 


b 
(b) z? —2z+2 


11.1-1 Finding the Inverse Transform 


As in the Laplace transform, we shall avoid the integration in the complex 
plane required to find the inverse z-transform [Eq. (11.2)] by using the (unilateral) 
transform Table. Many of the transforms F[z| of practical interest are rational 
functions (ratio of polynomials in z). Such functions can be expressed as a sum of 
simpler functions using partial fraction expansion. This method works because for 
every transformable f|{k] defined for k > 0, there is a corresponding unique F(z] 
defined for |z| > ro (where ro is some constant), and vice versa. 
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Table 11.1: (Unilateral) z-Transform Pairs 


1 6[k E j] y7 
2 uk] z 
z~-1 
3 kulk] 2 
(z-1)? 
4 kufk] 2(z +1) 
(z-1)} 
5 Ku e442 +1) 
(2-1) 
6 y*tulk ~ 1] 1 
z-7 
7 Fulk] z 
a 
8 ky*ulk] yz 
oy? 
9 k®yFulk] yz(z +7) 
(z - 7) 
k(k — 1)(k — 2)---(k -m +1) 
10 k z 
pa w goym 
lla |y|* cos Bk ufk] ___2(z—|yleos 8) 
z? — (2|y| cos B)z + |y? 
11b |y[Fsin Bk ufk] o zWsng 
z? — (2|y| cos B)z + |7]? 
12a rjyl* cos (Bk + 0)u[k] rz[z cos @ — [vl cos (6 — 0)] 
z? — (2|7| cos 8)z + |y}? 
12b rly|*cos (Gk + 4)ulk] y = lle?” te Le ae 
z= y z= y* 
12c riy" cos (Bk + 6)u[k] z(Az +B) 


r = ,/A2bP+B?-240B 


hy? -a 
B = cos™} z4, 0 =tan-! 4928 _ 
PpP As/|7|?—a? 


z2 + 2az + |7|? 
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Ml Example 11.3 
Find the inverse z-transform of 


z— 19 z(2z? — 11z + 12) 


8 2z(3z + 17) 
@) gae- © eje- 


(9) e 624 2) 


(a) Expanding F[z] into partial fractions yields 


Fiz] = — = + —z 
(z 
From Table 11.1, Pair 6, we obtain 


fik) = [3(2)*? +503)" 7] ulk - 1) (11.12a) 


If we expand rational F[z] into partial fractions directly, we shall always obtain an answer 
that is multiplied by u[k — 1] because of the nature of Pair 6 in Table 11.1. This form 
is rather awkward as well as inconvenient. We prefer the form that is multiplied by u[k] 
rather than u[k — 1]. A glance at Table 11.1 shows that the z-transform of every signal 
that is multiplied by u{k] has a factor z in the numerator. This observation suggests that 
we expand F[z] into modified partial fractions, where each term has a factor z in the 
numerator. This goal can be accomplished by expanding F[z]/z into partial fractions and 
then multiplying both sides by z. We shall demonstrate this procedure by reworking part 
(a) in Example 11.3. For this case 


Fiz] _ 8z — 19 
z  z(z-2)(z-3) 
_ (=19/6) _ (3/2) , (5/3) 
K z ji z=- 2 + z-3 


Multiplying both sides by z yields 


id= — +5 (s25) +3 Gea) 


From Pairs 1 and 7 in Table 11.1, it follows that 


fik] = — 26 fk] + [3(2)* + 3(3)*] afk] (11.12b) 


The reader can verify that this answer is equivalent to that in Eq. (11.12a) by computing 
fik] in both cases for k = 0, 1, 2, 3,---, and then comparing the results. The form in Eq. 
(11.12b) is more convenient than that in Eq. (11.12a). For this reason, we shall always 
expand F[z]/z rather than F[z] into partial fractions and then multiply both sides by z 
to obtain modified partial fractions of F[z], which have a factor z in the numerator. 


z(2z? — 11z + 12 
) Fela ea 


and 


Fiz] _ 22? —11z +12 


“z  (2—1)(z-2)8 


k 4 ao a sy a2 
~z-1' (z-2)38 | (z-2)? (z-2) 
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where 
2 pos 
pa Zote] _ i, 
__ Gm 
227 — ilz +12 
an = ZI = -2 
G e 
Therefore 
Fz} _ 2z?—-11z+12_ — -3 2 i a 
z (z 1)(z 2)8 TS (z 2)3 + G 27 + @-2 (11.13) 


We can determine a; and az by clearing fractions or by using the short cuts discussed in 


Sec. B.5-3. For example, to determine a2, we multiply both sides of Eq. (11.13) by z and 
let z — oo. This yields 


0=-3-0+0+a2 => a2 =3 


This result leaves only one unknown, ai, which is readily determined by letting z take any 
convenient value, say z = 0, on both sides of Eq. (11.13). This step yields 


12 
8 
Multiplying both sides by 8 yields 


a 


=3+ tr 


mJ 
2 


12 = 24 + 2 + 2a, -12 => a, = —1 


Therefore 
Fl} -3 _ _ 2 __1 3 


z 2-1 (@-28 e-ta 
and 


z z z z 
F[z] = —-3—— -2 
[z] S-E (z-2)8 (2-2)? +ee 5 


Now the use of Table 11.1, Pairs 7 and 10, yields 


s= [-a— 28 Dea - Farts ac uf] 


= —[3 + $ (k? + k — 12)2"]u[k] 


(c) Complex Poles 


Fle] = 2z(3z + 17) 2z(3z + 17) 
(z — 1)(2? — 62425) (z -—1)(z -3 ~ j4)(z -3 + j4) 


Poles of F[z] are 1, 3 + j4, and 3 — j4. Whenever there are complex conjugate poles, the 
problem can be worked out in two ways. In the first method we expand F[z] into (modi- 
fied) first-order partial fractions. In the second method, rather than obtaining one factor 
corresponding to each complex conjugate pole, we obtain quadratic factors corresponding 
to each pair of complex conjugate poles. This procedure is explained below. 
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Method of First-Order Factors 
Fiz] 2(3z +17) 2(3z + 17) 


= 1z- 3- j4) (z -3+ j4) 


z (z — 1)(z2 — 6z + 25 
We find the partial fraction of F({z]/z using the Heaviside “cover-up” method: 


Fiz] 2 1.6¢752746 —1.6¢3?-246 
z z-i" z-3-j4 z-3+j4 


and z 52.246 z j2.246 z 
Fi] =2727 + (16e 3 eae hee er F4 


The inverse transform of the first term on the right-hand side is 2uļk]. The inverse a 
form of the remaining two terms (complex conjugate poles) can be obtained from n 
(Table 11.1) by identifying $ =16,09 = —2.246 rad., y = 3+ j4 = 5e”? , so that Iyl = 5, 
B = 0.927. Therefore 


fk] = [2 + 3.2(5)* cos (0.927k — 2.246)| ujk] 


Method of Quadratic Factors 


Fiz] 2(3z + 17) _ 2 Az+B 
= +p 25 
z G- 1)(z2 -6z +25) z-1 z?-6z+ 


Multiplying both sides by z and letting z — oo, we find 


zid a3z¢17) 2 -2z +B 


— ees m + —_—— 
(z—1)(z? - 6z +25) z-1 z? — 6z + 25 
To find B, we let z take any convenient value, say z = 0. This step yields 


-34 B 
a 7 + OB 


Multiplying both sides by 25 yields 
—34=-50+ B= B=16 
Therefore 


Fi) 2 -2z +16 
z z—1l 2-—6z24+25 


and 
2z z(—2z + 16) 
PLS 721 t 26435 


We now use Pair 12c where we identify A = —2, B= 16, |y] = 5, a = -3. Therefore 


r = „ /19942586-192 = 3.2, p = cos *($) = 0.927 rad., and 
= tan7?(=2) = —2.246 rad., so that 


fik] = [2 + 3.2(5)* cos (0.927k — 2.246)| ujk) W 
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, The procedure for finding partial fractions using MATLAB was demonstrated 
in chapter 6. The same program can be used in this case, except that we have 
to find the modified partial fractions here. This goal is readily accomplished by 


dividing F[z] by z and then taking the partial fractions. We shall demonstrate this 
proced ure with an example. 


© Computer Example C11.1 
Solve Example 11.3a using MATLAB. 


num=[8 -19]; den=[conv((1 -2],[1 -3]) 0]; 
[r, p, k]= residue(num,den) 
% We could also express den=[1 -5 6 0] 


r= 


1.6667 
1.5000 
-3.1667 
p= 
3 
2 
0 
k = 
g 
Hence, 


1.5z 1.6667z 
F(z] = -—3.1667 + — + ————= 
k] ji z-2 + z-3 © 


A Exercise E11.2 
Find the inverse z-transform of the following functions: 
2(2z — 1) 1 


a lee os) ® GoErO8) 
9 5z(z — 1) 
(c) (z + 2)(z — 0.5)2 (a) z? —1.6z+0.8 


Answer: (a) [3+ $(-0.5)*] ufk] (b) —25[k] + [3 + $(-0.5)*] ufa] 
(c) 185[A] — [0.72(—2)* + 17.28(0.5)* — 14.4k(0.5)*]u[k] 


k 
(d) iyi (3) cos (0.464k + 0.464)u[k]. Hint: /0.8 = Z y 


Inverse Transform by Expansion of F[z] in Power Series of z~! 


By definition 


Fl] =J sikle 


k=0 


=j 8, 2, R.. 


= f[O]z° + [1]! + [2272+ f[3]2 7? +- 


This result is a power series in z~1. Therefore, if we can expand F'[z] into a power 
series in z~1, the coefficients of this power series can be identified as fio), F{2], f[2), 
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f[3], ---, and so on. A rational F [z] can be expanded into a power series of z7} by 
dividing its numerator by the denominator. Consider, for example, 


z*(7z — 2) 
Flel= Groay(2-08)@—1) 
723 — 22? 


~ 23 — 1.722 +0.8z—-0.1 
To obtain a series expansion in powers of z—!, we divide the numerator by the 
denominator as follows: 
7+9.927) + 11.23277411.87273 +- 
23 — 1.72? + 0.8z — 0.1)7z3 — 22? 
7z? — 11.922+ 5.60z—0.7 
9.922— 5.60z+0.7 
9.922—16.83z+ 7.92 — 0.9927! 
11.23z—7.22 + 0.99z71 
11.23z—19.09 + 8.9827! 


11.87 — 7.9927} 
Thus f 
z?(7z — 2) -1 -2 -3 
PEE L ee 9 11.2327? + 11.8727? +- 
riS rene ea ee ee í 
Therefore 


fl} =7, #1} =9.9, f[2] = 11.23, f{3] = 11.87, ---, and so on. 


We give here a simple MATLAB program to find the first N terms of the inverse 
z-transform. 


© Computer Example C11.2 

Using MATLAB, find the first 10 values (f[0} through f{9]) of the inverse z-transform 
of F|z] in the above example. 

num=(7 -2 0 0]; den=[1 -1.7 0.8 -0.1]; 

f=dimpulse(num, den, 10) 

% We could also write den=conv(conv([1 -0.2],{1 -0.5]), [1 -1]) 


f= 

7.0000 
9.9000 
11.2300 
11.8710 
12.1867 
12.3436 
12.4218 
12.4609 
12.4805 
12.4902 (©) 


680 11 Discrete-Time Systems Analysis Using the Z-Transform 


Although this procedure yields f [k] directly, it does not provide a closed-form 
solution. For this reason, it is not very useful unless we want to know only the first 
few terms of the sequence fk]. 

A Exercise E11.3 


Using long division to find the power series in z~!, show that the inverse z-transform of 
2/(z — 0.5) is (0.5)*u[k] or (2)—Fufk]. y 


Relationship Between h[{k] and H{z] 


For an LTID system, if A[k] is its unit impulse response, then in Eq. (9.57b) 
we defined H [z], the system transfer function, as 


co 


H[z]= J afele-* 


k=-—00 


For causal systems, the limits on the sum are from k = 0 to oo. This equation 
shows that the transfer function H[z] is the z-transform of the impulse response 
h[k] of an LTID system; that is 


blk] => Hfz] (11.14) 


This important result relates the impulse response h[k], which is a time-domain 
specification of a system, to H [z], which is a frequency-domain specification of a 
system. The result is parallel to that for LTIC systems. 


A Exercise E11.4 
Redo Exercise E9.5 by taking the inverse z-transform of H lz} Vv 


11.2 Some properties of the Z-Transform 


The z-transform properties are useful in the derivation of z-transforms of many 
functions and also in the solution of linear difference equations with constant coef- 
ficients. Here we consider a few important properties of the z-transform. 


Right Shift (Delay) 


If 
f|k}ulk] = F[z] 
then 
fik- ie 1] = “Fle (11.158) 
and 
nn eon eee FE] (11.15b) 
and 


fik = lulk] = FE + f[-1] (11.16a) 
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Repeated application of this property yields 
silk — 2Jufk] = [Ft ip su] + fl-2 
=F le] + t1] + fl-3 (11.16b) 
z z 
and 


fik — mJulk] = 27" F [2] +27" Y f[-k]z* (11.16c) 
k=1 


Proof: 


PG e> allem SS. baile ae 


k=0 


Recall that f[k — m]u[k — m} = 0 for k < m, so that the limits on the summation 
on the right-hand side can be taken from k = m to oo. Therefore 


Z {fle — mule — m]} = $> fft - m] 


k=m 


= offre ot 
r=0 


= = Y firl 


r=0 


å FFE] 


To prove Eq. (11.16c), we have 


Z{f|k — mju[k]}} = il mjz—* = 5D flre 
k=0 


r=-m 


=ar S file + Dost 


r=-m r=0 


=," i +27" F[z] 
k=1 
Left Shift (Advance) 
If 
f{klulk] => Ffi] 


hen 
i fik + ljulk] = zF[z] — zf [0] (11.17a) 
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Repeated application of this property yields 


flk + Qlufk] = z {z (F[z] — zf[0]) — s111} 


= z°F [2] — 2? f [0] — zf [1] (11.17b) 
and 
m-l 
fik + m]ufk] => 2" F [z] - 2" X fik] (11.17c) 
k=0 


Proof: By definition 


Asle + mlulkl) = So sk + mf 


k=0 


= >D flr] 

o> flle” 
co m-1 

z™ Sse" - >? firj” 
r=0 r=0 


=ar- S stele 


r=0 


Il 


Fig. 11.4 Signal for Example 11.4. 


| Example 11.4 
Find the z-transform of the signal f[k] depicted in Fig. 11.4. 


The signal f[k] can be expressed as a product of k and a gate pulse u[k] — ufk — 6]. 
Therefore 


fk] = k {ulk} — ule — 6)} 
= kulk] — ku[k — 6] 
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We cannot find the z-transform of ku[k — 6] directly by using the right-shift property [Eq. 
(11.15b)]. So we rearrange it in terms of (k — 6)u[k — 6] as follows: 


fk] = kulk] — [(k — 6)ulk — 6] + 6u[k — 6] 


We can now find the z-transform of the bracketed term by using the right-shift property 
[Eq. (11.15b)]. Because u[k] — > = 


z-i 


1 z 1 
ulk - 6 > a71 PG) 


Also, because kufk] <=> žy 


1 z 1 
(k — 6)u[k - 6] => APENE = BG- 
Therefore 


z 1 6 
F= (2-1)? 28(z-1)? z5(z-1) 


_2-6z+5 og 
~ 28(z— 1)? 


A Exercise E11.5 
Using only the fact that u[k] <=> ;2; and the right-shift property (Eq. (11.15)], find the 


z-1 
z-transforms of the signals in Figs. 11.2 and 11.3. The answers are given in Example 11.2d and 


Exercise Ell.la. V7 


Convolution 
The time convolution property and the frequency convolution property state 


that if 
fifk] < F,[z] and folk) < F,[z], 


then (time convolution) 
filk] * folk] <> Filz]Falz] (11.18) 


and (frequency convolution) 


falk] folk] <=> 5 frp [=| ul du (11.19) 


Proof: These properties apply to causal as well as noncausal sequences. For 
this reason, we shall prove them for the more general case of noncausal sequences, 
where the convolution sum ranges from —oo to oo. To prove the time convolution, 
we have 


Z {filk] * falk]} = Z | X film) folk - m| 
= > z* 5 film] folk — m] 
k=- m=—oo 
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Interchanging the order of summation, 


Z[flkl* folk] = S> Alm] > folk — m]z~* 
m=— 00 k=—00 
= È film) So salle 
= > fme” SO Rre” 
= Fylz|Falz] 


To prove the frequency convolution, we start with 


Z{filklfolkl} = So filklfelkle* 


| 

| 

k=—00 | 
| 


1 co 
= Oni > falkle“* $ Falu du 
k=—00 


Interchanging the order of summation and integration 


| 
| 
Z nifl] = z $ Fill | le ()" wt du 


k=--00 
1 


Ses a | 
Oni F,({u]F2 [=| udu 


LTID System Response 
It is interesting to apply the time convolution property to the LTID input- 
output equation y[k] = f [k]*h[k]. In Eq. (11.14), we have shown that h[k] <=> H [z]. 
Hence, according to Eq. (11.18), it follows that 
Y [z] = F[z]H[z] (11.20) 
Earlier in the chapter, we derived this important result using informal arguments. 
Multiplication by 7" 
If 
f{klulk] = Fiz] 
then 
v" f [klulk] = F El (11.21) 


Proof: 


Z{y" f{klule]} = 2a [k] =" = 2i i (2) i n 
= k=0 
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A Exercise E11.6 
Using Eq. (11.21), derive Pairs 7 and 8 in Table 11.1 from Pairs 2 and 3, respectively. V 


Multiplication by k (Scaling in the z-Domain 


If 
f{kjulk] <=> Fle] 
then 
kf [k]ulk] <> -z4 FẸ (11.22) 
Proof: 
za aR -k S -k—1 
zz; Fk] = zz Ske = DD kf[k]z 
k=0 k=0 


= X kf [k] 7" = Z {kf [k]u[k]} 
k=0 


A Exercise E11.7 
Using Eq. (11.22), derive Pairs 3 and 4 in Table 11.1 from Pair 2. Similarly, derive Pairs 8 
and 9 from Pair 7. Y 


Initial and Final Value 


For a causal f {k], 
fio] = lim Ffz] (11.23a) 
z—00 
This result follows immediately from Eq. (11.9) 
We can also show that if (z — 1)F (z) has no poles outside the unit circle, then 


Jim F(N) = lim - 1)F(z) (11.23b) 


11.3 Z-Transform Solution of Linear Difference Equations 


The time-shifting (left- or right-shift) property has set the stage for solving 
linear difference equations with constant coefficients. As in the case of the Laplace 
transform with differential equations, the z-transform converts difference equations 
into algebraic equations which are readily solved to find the solution in the z- 
domain. Taking the inverse z-transform of the z-domain solution yields the desired 
time-domain solution. The following examples demonstrate the procedure. 


@ Example 11.5 
Solve 
ylk + 2] — 5ylk + 1] + 6y[k] = 3f[k + 1] + 5f(k] (11.24) 


if the initial conditions are y[-1] = #, yl-2] = 37, and the input f[k] = (2)~*ufk]. 
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Table 11.2 


Z- Transform Operations 


ea L Ř 


Operation fik] Fiz] 
Addition Jilk] + f2[k] Fife] + Fo[z] 
Scalar multiplication af[k] aF[z] 
Right-shift fik — mJu[k — m] Fla 
flt- mjuk] | Fe] E D reas 
k=1 
fk- ilf) Fle] + fi- 
fe- zuk) Fle] + Es + F-2 
1 1 1 
fk-3 Stel + Spy Esa + fl-3 
m~1 
Left-shift fik + mJu[k] 2™ F(z} —z™ D fikle 
k=0 
Fik + Yulk] zF[z] — zf[0] 
fik + 2]ufk] 2°F[z} — 27 f[0] - zf] 
fik + 3}u[r] F(z] — 2° f[0] — 27F(1] - zf[2] 
Multiplication byy” ——_-* f[k]u[k] F B 
Multiplication by k kf [k}u[k] -22F [z] 
Time Convolution falk] * folk] F(z] Fa[z] 


Frequency Convolution — f;[k] f2[k] FA § FilulFe [2] udu 


Initial value fio) limz—oo F[z] 
Final value limn—oo f[N] limz—3(z — 1)F[z] poles of 


(z — 1)F[z] inside the unit circle. 
SE T Ah AT 
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As we shall see, difference equations can be solved by using the right-shift or the left- 
shift property. Because the difference equation (11.24) is in advance-operator form, the 
use of the left-shift property in Eqs. (11.17a) and (11.17b) may seem appropriate for its 
solution. Unfortunately, as seen from Eqs. (11.17a) and (11.17b), these properties require a 
knowledge of auxiliary conditions y[0], y[1],---,y[n—1] rather than of the initial conditions 
y{-1], y[-2],---,y[-n], which are generally given. This difficulty can be overcome by 
expressing the difference equation (11.24) in delay operator form (obtained by replacing k 
with k — 2) and then using the right-shift property.{ Equation (11.24) in delay operator 
form is 

ylk] — 5y[k — 1] + 6y[k — 2] = 3f[k — 1] + 5f[k — 2] (11.25) 


We now use the right-shift property to take the z-transform of this equation. But before 
proceeding, we must be clear about the meaning of a term like y{k — 1]. Does it mean 
yk — 1Ju[k — 1] or y[k — 1]u[k]? The answer becomes clear when we recognize that the 
use of the unilateral transform implies that we are considering the situation for k > 0, 
and that every signal in Eq. (11.25) must be counted from k = 0. Therefore, the term 
ylk — j] means y[k — j]u{k]. Remember also that although we are considering the situation 
for k > 0, y[k] is present even before k = 0 (in the form of initial conditions). Now 


ylklu[k] <=> Y[z] 


vlk — Mule] = ŻY fe] + yl-1] = SY fe) + E 
vlk — Julk] = ZY le] + E +s grtt 
Also 
lk] = (2) Fuk] = (27 ula = (0.5)*ufk] = — 
fik = lulk) = SFe] + si = +5 +0= 
fik- Qulh] = Fle] + Sf + fl-2 = Fel +0 +0 = PES 


Note that for causal input f[k], 


FL- = f[-2]=--- = f[-n] =0 


Hence 
Slk - rjulk] => Fe] 


Taking the z-transform of Eq. (11.25) and substituting the above results, we obtain 


¥ [2] s| Yiz] + =] +6 [are +o + z] = TT S5 (11.26a) 
a ree a 
( s E) T e ra (11266) 


fAnother approach is to find y[0], y[1], y[2],---,y[n — 1] from y[- y y[—2],---, y[—n] iteratively, as 
in Sec. 9.1-1, and then apply the left-shift property to Eq. (11.24 
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and 


(1-2+5)vta=(3-+)+ Set 
z z 2 


z({z — 0.5) 
_ 3z? —9.5z + 10.5 
z(z — 0.5) 


Multiplication of both sides by z? yields 


2 
aaeoa O euy 


(z — 0.5) 
so that ( > ) 
2(3z* — 9.52 + 10.5 
Y [z] = Te —0.5)(2? — 5z + 6) (11.27) 
and 
Y[z] _ _ 32? - 9.5z + 10.5 
z  (z—0.5)(z — 2)(z — 3) 
_ (26/15) - (7/3) (18/5) 
2-05 2-2 z~-3 
Therefore 26 7 18 
z z z 
We ea sea) Ga) 
and 26k Tor, IBak 
y{k] = [i5 (08) -37+ = 3) | ek (11.28) 
a 


This example demonstrates the ease with which linear difference equations with 
constant coefficients can be solved by z-transform. This method is general; it can 
be used to solve a single difference equation or a set of simultaneous difference 
equations of any order as long as the equations are linear with constant coefficients. 


Comment 
Sometimes auxiliary conditions y{0], y[1],---,y[n — 1] (instead of initial condi- 
tions y|-1], y[—2],---,y[—-n]) are given to solve a difference equation. In this case, 


the equation can be solved by expressing it in the advance operator form and then 
using the left-shift property (see Exercise E11.9 below). 


A Exercise E11.8 
Solve the equation below if the initial conditions are y[~1] = 2, y[-2] = 0, and the input 
S[k] = ufk]: 
ylk +2] — Bulk + 1] + sulk] = 5f[k + 1] — FIR] 


Answer: y[k] = [12 — 15(3)* + 48(2)*] afk] y 


A Exercise E11.9 
Solve the following equation if the auxiliary conditions are y[0] = 1, y[1] = 2, and the input 
f[k] = ulk]: 
ylk + 2] + 3y[k + 1] + 2y[k] = f[k + 1] + 3ffk} 
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Answer: y[k] = [2 +2(-1)* — 3(-2)*] ulk] y 


Zero-Input and Zero-State Components 


In Example 11.5 we found the total solution of the difference equation. It is 
relatively easy to separate the solution into zero-input and zero-state components. 
All we have to do is to separate the response into terms arising from the input and 
terms arising from initial conditions. We can separate the response in Eq. (11.26b) 
as follows: 


5 6 11 3 5 
1- 2+2 }\Yjz]- go a ee 11.29 
( 2+5) [z] ( 2) Fob | 2(2=05) ( ) 
—— ed 
initial condition terms terms arising from input 
Therefore E ug ü (3 +5) 
z+ 
1- 2+ )Y[]= J awa 
( z + 5) e] ( z ) t z(z — 0.5) 
—— i 


initial condition terms input terms 


Multiplying both sides by z? yields 


(22-52+6)¥[e]= (32-11) + la 
——— z-0.5 
initial condition terms | 
input terms 
and 
z(3z — 11) 2(3z + 5) 


Y[z] = (11.30) 


z2—5z+6 
——S 


zero-input response 


(z — 0.5)(z? — 5z + 6) 
Sod 
zero-state response 


We expand both terms on the right-hand side into modified partial fractions to yield 


r= (es) (5) EF n) 3 G)3 


zero-input zero-state 


and 


ylk] = |5(2)* — 2(3)* — 2 (2)* + B(3)* + 180.5)" | u[k] 


zero-input zero-state 
= [-2(2)* + 48(3)* + 28(0.5)*) uff] 


a conclusion, which agrees with the result in Eq. (11.28). 


A Exercise E11.10 
Solve 
ylk +2] — ylk + 1) + gulk] = 5ffk + 1) — fk] 


if the initial conditions are y[—1] = 2, y[—2] = 0, and the input f[{k] = u[k]. Separate the response 
into zero-input and zero-state components. 
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Answer: 
slk] = ¢ BG- $G) + [12 -— 18(3)* + 6(4)*] $ ulk] 
—e—o oOo 


zero-input zero-state 


= [12 ~15(3)* + HG] ula] v 


11.3-1  Zero-State Response of LTID Systems: The Transfer Function 
Consider an nth-order LTID system specified by the difference equation 


Q[E]y[k] = P[E]F [k] (11.31a) 
or 
(E° +an_1E""} +- +ajE + ao)y[k] = 
(bnE” + bp E”! +++. +b; E +60) f[k]  (11.31b) 
or 


ylk +n] +an-iylk +n — 1] +--- + ary[k + 1] + aoy[k] 
= baflktn)+---+bif[k +1) +bof[k} (11.310) 
We now derive the general expression for the zero-state response; that is, the system 
response to input f[(k] when all the initial conditions y[—1] = y{-2] = --- = y[-n] = 
0 (zero state). The input f{k] is assumed to be causal so that f[-1] = f[-2] = 
eis = fl-a) =Q. 
Equation (11.31c) can be expressed in the delay operator form as 
ylk] + an—ay[k — 1] +--+ + aoyfk ~ n] 
= bnf [k] + bn-if[k — 1] +--+ +bof[k —n] (11.314) 


Because y(—r] = f[-r] = 0 for r = 1, 2, ..., n 
y[k — mu[k] => FYE 
flk — mul] => =F le maiin 


Now the z-transform of Eq. (11.31d) is given by 


Qn = bn- bn- b 
(14 E 4 mt BY vial = (tnt Bel op e+ B) Fi 
z z zZ z z z 
Multiplication of both sides by z” yields 


(2 +an_y2z7 1 +--+ az + ao)Y |z] 
= (bnz” +bn-12"7l +- +biz + bo) F [z] 


| 
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Fiz] Y [z]=F{z]H [z] 


Fig. 11.5 The transformed representation of an LTID system. 


Therefore 
bn n bn n-1 pine b 
vied = ( i es a aT (11.32) 
zZ? + An 4z +---+a iz + a9 
Plz] 
= Flz 11.33 
are (11.33) 


We have shown in Eq. (11.20) that Y [z] = F[z]H[z]. Hence, it follows that 


Plz] _ bnz” +bn-1z”7} +--+ biz + bo 
~ Qjz] z® tan_yz™-1 +--+. Faz + ao 


(11.34) 


As in the case of LTIC systems, this result leads to an alternative definition of 
the LTID system transfer function as the ratio of Y[z] to F[z] (assuming all initial 
conditions zero). 


_ Y[z] _ Z[zero-state response] 


Because Y|z], the z-transform of the zero-state response y{k], is the product 
of F[z] and H[z], we can represent an LTID system in the frequency domain by 
a block diagram, as illustrated in Fig. 11.5. Just as in continuous-time systems, 
we can represent discrete-time systems in the transformed manner by representing 
all signals by their z-transforms and all system components (or elements) by their 
transfer functions. 

Observe that the denominator of H |z] is Q[z], the characteristic polynomial of 
the system. Therefore the poles of H(z] are the characteristic roots of the system. 
Consequently, the system stability criterion can be stated in terms of the poles of 
the transfer function of an LTID system as follows: 


1. An LTID system is asymptotically stable if and only if all the poles of its 
transfer function H[z] lie inside a unit circle (centered at the origin) in the 
complex plane. The poles may be repeated or unrepeated. 


2. An LTID system is unstable if and only if either one or both of the following 
conditions exist: (i) at least one pole of H [z] is outside the unit circle; (ii) there 
are repeated poles of H[z] on the unit circle. 


3. An LTID system is marginally stable if and only if there are no poles of H [z] 
outside the unit circle, and there are some unrepeated poles on the unit circle. 
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fik] ujk] fIk-i} u [k1] | 
Fiz] j 


] via=4 Fiz] 
z 


Fig. 11.6 Ideal unit delay and its transfer function. 


@ Example 11.6: The Transfer Function of a Unit Delay 
Show that the transfer function of a unit delay is 1 /z. 
If the input to the unit delay is f[k]u[k], then its output (Fig. 11.6) is given by 


yik] = f[k — tJu[k — 1] 


The z-transform of this equation yields [see Eq. (11.15a)] 


Y{z] = +P [2] 
= H[z}F{e} 


It follows that the transfer function of the unit delay is 
1 
H[z} = = (11.36) 


a Example 11.7 i 
Find the response y{k] of an LTID system described by the difference equation 
ylk +2] + yk + 1] + 0.16y[k] = fik + 1] + 0.32f [k] 


or 
(E? + E + 0.16)y[k] = (E + 0.32) f[k] 


for the input f{k] = (—2)~*u[k] and with all the initial conditions zero (system in zero 
state initially). 
From the difference equation we find 


Plz] _ z+0.32 
Qjz] z?+z+0.16 


For the input f[k] = (—2)*u[k}] = [(-2)~]*u(k) = (—0.5)Fu[k] 


Alz] = 


z 


Fe) = z705 
and (2 + 0.32) 
ziz +0. 
YE) SFERI (22 + z +0.16)(z + 0.5) | 
Therefore ' 
Y[z] _ (z + 0.32) (z + 0.32) 
z  (2}z+0.16)(2 +05) (z +0.2)(2 + 0.8)(z + 0.5) ! 
2/3 8/3 2 


“8400 z+08*z405 (11.37) 
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so that 


wia i) ew 


vlk] = [3(—0.2)* ~ $(—-0.8)* + 2(—0.5)"] ufk] E 


and 


© Computer Example C11.3 
Solve Example 11.7 using MATLAB. Plot y[k] for 0 < k < 10. 
k=0:10; 
b=[0 1 0.32]; 
a=[1 1 0.16]; 
f=(-2).°(-k); 
y=filter(b,a,f); 
stem(k,y) 
xlabel(’k’);ylabel(’y[k]’) © 


A Exercise E11.11 
A discrete-time system is described by the following transfer function: 


z-0.5 


Hl = Gyo =D 


(a) Find the system response to input f{k] = 3~(*+1)u{k] if all initial conditions are zero. (b) 
Write the difference equation relating the output y{k] to input f[k] for this system. 

Answers: (a) y{k] = } [3 — 0.8(-0.5)* + 0.3 (4)*] uff] 

(b) yfk + 2] — 0-5y[k + 1] — 0.5y[k] = fik +1} - 05fik]) y 


11.4 System Realization 


We now discuss ways to realize an nth-order discrete-time system described by 

a transfer function 
bnz” + bp_yz™} +--+ +biz + bo 
z” +@n-12% 14---+a1z +49 


H{z] = (11.39) 
This transfer function is identical to the general nth-order continuous-time transfer 
function H(s) in Eq. (6.70) with s replaced by z. It is reasonable to believe that the 
realization of H [z] in (11.39) would be identical to that of H (s) with s replaced by 
z. Fortunately this happens to be the case. In realizations of H (s) the basic element 
used was an integrator with transfer function 1/s. In realizations of H[z] the basic 
element is unit delay with transfer function 1/z. Therefore, all the realizations of 
H(s) studied in Sec. 6.6 are also the realizations of H [z] if we replace integrators 
by unit delays. To demonstrate this point, consider a realization of a third-order 
transfer function. 


b3z3 + bz? + bız + bo 
z3 + aaz? + aiz + ao 


Figure 11.7 shows Fig. 6.21 with all the integrators (with transfer function 1/s) 
replaced with unit delays (with transfer function 1/z). We shall now show that this 


Hz] = (11.40) 
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Fig. 11.7 A canonical realization of H [z]. 


realization indeed represents H [z] in Eq. (11.40). Let the signal at the output of 
the third delay be X [z]. Consequently, signals at the inputs of the second and the 
first delay are zX [z] and z?X[z]. The first summer output z°X [z} is equal to the 
sum of the four inputs to that summer. Therefore 


z°X [|z] = —agz?X [z] — aızX Íz] — aoX [z] + F[z] 


so that 


(z3 +a2z? + aiz + ag)X [z] = F [z] (11.41) 


Moreover, Y [z], the output of the second summer, is equal to the sum of four signals 
to that summer. Therefore 


Y [z] = (b3z? + b22? + biz + bo) X [z] (11.42) 


From Eqs. (11.41) and (11.42), it follows that 


Y [z] _ b3z? + bez” + bız + bo 


F(z] z3 + a9z2+a1z + ap 


This result shows that Fig. 11.7 is indeed a realization of H |z} in Eq. (11.40). Sim- 
ilarly, the cascade and parallel realizations of the continuous-time case are directly 
applicable to discrete-time systems, with integrators replaced by unit delays. The 
second canonical realization developed in Appendix 6.1 also applies to discrete-time 
case with 1/s replaced by 1/z. 
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@ Example 11.8 i 
Realize the following transfer functions, using only the cascade form for part a and 
using only the parallel form for part b. 


4z +28 72? +37z +51 
A{z] = —=———— (b) Hfz] = ————— 

(a) Hi z2? +6z+5 (b) Hiz] (z + 2)(z + 3)? 

Identical transfer functions for continuous-time systems are realized in Figs. 6.27 and 
6.28. a 


A Exercise E11.12 


2 8 
Give the canonical realization of the following transfer functions. (a) —— (b) fk 
39h z+5 z+5 
z z 
YZ 
©) zys © Bayete 


Answer: See Example 6.18. Replace 1/s by 1/z and make appropriate changes in coefficients. Vv 


11.5 Connection between the Laplace and the Z-Transform 


We now show that discrete-time systems also can be analyzed using the Laplace 
transform. In fact, we shall see that the z-transform is the Laplace transform in 
disguise and that discrete-time systems can be analyzed as if they were continuous- 
time systems. 

So far we have considered the discrete-time signal as a sequence of numbers 
and not as an electrical signal (voltage or current). Similarly, we have considered a 
discrete-time system as a mechanism that processes a sequence of numbers (input) 
to yield another sequence of numbers (output). The system was built by using 
delays (along with adders and multipliers) that delay sequences of numbers, not 
electrical signals (voltages or currents). A digital computer is a perfect example: 
every signal is a sequence of numbers, and the processing involves delaying sequences 
of numbers (along with addition and multiplication). 

Consider a discrete-time system with transfer function H [z] and an input f [k], 
as shown in Fig. 11.8a. We can think of (or generate, for that matter) a correspond- 
ing continuous-time signal f(t) consisting of impulses spaced T seconds apart. Let 
the kth impulse of strength be f[k] as depicted in Fig. 11.8b. Thus 


F(t) =X fikle - kT) (11.43) 


k=0 


Figure 11.8 shows f[k] and corresponding f(t). Let us now consider a system 
identical in structure to the discrete-time system with transfer function H [z], except 
that the delays in H [z] are replaced by elements that delay continuous-time signals 
(such as voltages or currents). If a continuous-time impulse 6(t) is applied to such 
a delay of T seconds, the output will be 6(t — T). The continuous-time transfer 
function of such a delay is e~‘7 {see Eq. (6.54)]. Hence, the delay elements with 
transfer function 1/z in the realization of H [z] will be replaced by the delay elements 
with transfer function e~°7 in the realization of the corresponding H(s). This step is 
the same as z being replaced by e°7. Therefore, the transfer function of this system 
is H[z] with z replaced by e°?. Thus H(s) = H [eT]. Now whatever operations are 
performed by the discrete-time system H [z] on f[k] (Fig. 11.8a) are also performed 
by the corresponding continuous-time system H [e"T] on the impulse sequence f (t) 
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Sr 


Fig. 11.8 Connection between the Laplace and z-transform. 


(Fig. 11.8b). The delaying of a sequence in H[z] would amount to the delaying 
of an impulse train in H{e°7]. The case of adding and multiplying operations is 
similar. In other words, one-to-one correspondence of the two systems is preserved 
in every aspect. Therefore, if y{k] is the output of the discrete-time system in Fig. 
11.8a, then y(t), the output of the continuous-time system in Fig. 11.8b, would be 
a sequence of impulses whose kth impulse strength is y[k]. Thus 


a(t) = So ylk]6(t - kT) (11.44) 
k=0 


The system in Fig. 11.8b, being a continuous-time system, can be analyzed by using 
the Laplace transform. If 


F(t) = F(s) and g(t) = F(s) 


then 
Y (s) = H[e*"|F(s) (11.45) 
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Also = 
F(s)=L È flkj6(t — wn] 
k=0 


Now, because the Laplace transform of 6(t — kT) is e Skt 
k co 
F(s) = X flkle ** (11.46) 
k=0 
Similarly 
. co 
¥(s) = X ylkje*? (11.47) 
k=0 


Substitution of Eqs. (11.46)and (11.47) in Eq. (11.45) yields 


Sulke”? = Hle] $ siae] 
k=0 


k=0 


By introducing a new variable z = eT, this equation can be expressed as 
y 8 q p 


So ulkle* = H [e] X sikle" 
k=0 


k=0 
or 
Y [z] = H [z]F [2] 


where 


Fle} =J fik] and Yiz] = $ y[k] 
k=0 k=0 


It is clear from this discussion that the z-transform can be considered as a Laplace 
transform with a change of variable z = e°7 or s = (1/T)lnz. On the other hand, 
we may consider the z-transform as an independent transform in its own right. 
Note that the transformation z = e®? transforms the imaginary axis in the s-plane 
(s = jw) into a unit circle in the z-plane (z = eT = eJ#T or |z| = 1). The LHP 
and RHP in the s-plane map into the inside and the outside, respectively, of the 
unit circle in the z-plane. 


11.6 Sampled-data (Hybrid) Systems 


Sampled-data systems are hybrid systems consisting of discrete-time as well 
as continuous-time subsystems. Consider, for example, a fire control system. In 
this case, the problem is to search and track a moving target and fire a projectile 
for a direct hit. The data obtained from the search and tracking radar is discrete- 
time data because of a scanning operation, which results in sampling of azimuth, 
elevation, and the target velocity. This data is now fed to a digital (discrete-time) 
processor, which performs extensive computations. The computer output is then 
fed to a continuous-time plant, such as a gun mount, which accordingly positions 
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Discrete-time Continuous-time 
controller plant 


x(t) 


Sik e [k] e (t) yO 


(c) 


yk Ideal 


Sampler 


Fig. 11.9 Typical sampled-data systems. 


itself at a certain position and fires. Another example is attitude-control problem 
in a spacecraft, where the information about the actual spacecraft attitude is fed 
back to a digital processor, which generates corrective input to be applied to the 
spacecraft, which is a continuous-time system. In automatic periodic quality check 
in production line, the discrete-data obtained from the periodic check, after some 
digital processing, generates the corrective input to be applied to a continuous-time 
plant. In complex control systems, use of digital processor as a controller or a 
compensator for continuous-time plants is growing rapidly. 

In time-sharing systems, where, for economic reasons, certain facilities are 
shared by several systems, the signals are, by nature, discrete-time or sampled. 
In regulator type control systems, where an output variable must be maintained 
at a constant value, the external disturbance and plant parameters variations are 
usually so slow that continuous monitoring (or feedback) is unnecessary. It is ade- 
quate to sample the output periodically and then feed back this discrete-data. In 
such cases, feedback transducers, data-processing facilities and possibly long and 
expensive feedback communication facilities can be shared among several control 
systems. 

Figure 11.9 shows some typical sampled-data systems. Figure 11.9a contains 
a digital processor, whereas in Fig. 11.9b, the sampled signal is directly applied to 
D/A converter (the hold circuit) without further digital processing. Figure 11.9c 
shows a practical system, where the input signal itself is a discrete-time signal 
fik], and the sampler is in the feedback path. This system is equivalent to that 
in Fig. 11.9b. How do we analyze such hybrid systems, where continuous-time and 
discrete-time signals intermingle? An effective strategy in such a situation is to 


annalaatiindineatnennin 
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relate the samples of the output to those of the input. But, this procedure yields 
information about the output only at sampling instants. We can overcome this 
difficulty by taking the samples at instants in between samples using the modified 
z-transform as explained later. 

In sampled-data systems, the discrete-time signals are often obtained as a result 
of sampling continuous-time signals. These samples are narrow pulses, which may be 
considered as impulses, provided the pulse width is small compared to the system 
time constant. Thus, in the following discussion, a discrete-time signal, when it 
appears in conjunction with a continuous-time system, is a sequence of impulses 
rather than a sequence of numbers. Hence, a discrete-time signal f[k] can also be 
considered as continuous-time signal f(t), where 


f(t) = So F[e]6(t - kT) 
k 


Observe an interesting fact: in this representation a discrete-time unit impulse 
6[k] is the continuous-time unit impulse 6(t). Thus, at the input of a discrete-time 
processor, a discrete-time signal f [k] is just a sequence of numbers. But at the input 
of a continuous-time system, f [k] is a sequence of impulses. There are appropriate 
converters at the interface of discrete-time and continuous-time systems to carry 
out signal conversion to appropriate forms. 

To begin with, consider a basic continuous-time system (Fig. 11.10a) with 
transfer function H(s). The input f(t) is sampled and the sampled signal f{k] is 
applied to the input of H(s). Although y(t), the output of this system, is continuous, 
we shall endeavor to find the values of y(t) only at the discrete instants t = kT. 
Such an analysis is relatively simple using the method of z-transform. For this 
purpose, we consider as if the output is sampled by an hypothetical sampler shown 
dotted in Fig. 11.10a. Now, we shall relate the input samples f[k] and the output 
samples y{k]. Let h[k] be the unit impulse response relating the output samples 
to the input samples. In other words, y{k] = A[k] * f[k]. Recall also that an unit 
impulse 6[k] is 6(¢) when considered in conjunction with a continuous-time system. 
Hence, h[k], the unit impulse response is the sampled version of the system’s unit 
impulse response h(t). Thus, 


hk] = h(kT) 


where T is the sampling interval. For instance, if H (s) = ~4;, then h(t) = e** and 


Therefore, the equivalent discrete-time transfer function H [z] of this system is given 
by 
H(z] = Z{h[k]} 
= Zle**F| 


eye ae (11.49) 
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yk} 
aero Yiz} = Alz}F Iz} 


fik 


Yiz] = GH[z}Ffz] 


Yiz] = G{zlA[z]F 12] 


Ý; G{z] 
"l= Ty emg 


Fig. 11.10 Computing the output in hybrid or sampled-data systems. 


Thus, Hfz] is the discrete-time transfer function of H(s) = =}, that relates y[k] 
(the output samples) to the discrete-time input f[k].t 

If we have two systems with transfer functions G(s) and H(s) in cascade (Fig. 
11.10b), the equivalent transfer T [z] # G[z]H[(z], but is GH [z], where G[z], H [z] and 
G H [z] correspond to discrete-time transfer functions of G(s), H (s) and G(s)H(s), 
respectively. For instance, if 


G(s) = 


1 
d H(s)=- 
s+2 = (s) 8 


Then, according to Eq. (11.49) 


z 
Gl] = ar and He] =- 


However, the continuous-time system transfer function is G(s)H(s), where 
1 1j1 1 
G(s)H (s) = —— = = |- - — 
(s)H (s) s(s+2) 2 ; s h 
And from Eq. (11.49) 


{Using this procedure, we have listed H(s) and corresponding H [z] in Table 12.1 in Chapter 12. 
In this Table, H[z] is multiplied with a scaling factor T, which results in H[z] = r For the 


PIS 
purpose of the sampled data application, the extra factor T should be ignored throughout in Table 
12.1. 
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1 z z 
wel = (4 - ear) 4 oleae 
In this case, we use the notation GH [z2] for T[z]. Thus, GH [z] # G[z]H[z], but is 
the discrete-time transfer function which corresponds to G(s)H (s). 
For the system in Fig. 11.10c, 


Y [z] = H [z]}X [z] = H[z}G[z]F [z] so that 
For the system in Fig. 11.10d, 


T(z] = G[z]H [z] 


E{z] = F[z] — W[z] 


Moreover, 
W [z] = A[z]¥ [z] 
Y [z] = G[z]E [2] 
= Gle] (Flal - Wie) 
= Gfe\( Fle] - H [)Y [2l) 
Hence ate) 
¥[z] = Irca" 
Consequently 
___ Ck] 
TĪ] = 1 + G[z]H[z} 


@ Example 11.9 
Find the output samples y[k] for the sampled-data system illustrated in Fig. 11.ila 
when the input is a unit step function u(t), the sampling interval T = 0.5 second and 
z 1 
and G(s) = reer 
This system has a discrete-time controller and a continuous-time plant.t To find the 
transfer function of this system, we observe that 


G-[z] = 


z-1 


¥([z] = G[z]X[z], X{z] = G.[z]E[z], and E(z] = F[z] — Y [z] 


Hence 
Y [z] = Ge[z]G@[z](F le] - Y{2)) 
and the system transfer function T[z] is 


_ Ye] _ _ Gelz}@lz] 


Te) = FE) = 14 Gide] 


+The block diagram in Fig. 11.11a does not show the appropriate converters required at the 
interface of discrete-time and continuous-time systems; these are implied. Thus, the output of the 
sampler, which consists of impulse sequence, is converted into sequence of numbers to act as the 
input to the discrete-time controller. Similarly, the output of a discrete-time controller, which is 
a sequence of numbers, is converted to a sequence of impulses to act as an input to the plant. 
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Discrete-time Continuous-time 


controller plant 


1 yA 
0.8 
0.6 
0.4 f 
0.2 
0 T 2T 3T 4T 5T 6T IT 8T 9T 


Fig. 11.11 The sampled-data system in Example 11.9. 


For G(s) = 1/(s + 4) and T = 0.5, we find, from Eq. (11.49), G[z] = —=5 = z0 T3 
Also Ge[z] = z/(z — 1). Substitution of these expressions in Tz] yields 


2 


Ti] = (2 — 0.394)(z — 0.174) 


The output Y[z] is given by Y[z] = T{z]F[z]. For the step input f(t) = u(t), the corre- 
sponding sampled signal is u[k] so that F[z] = z/(z — 1). Hence, 


Yl =THIF el = CG osae —0.17h) 


and 
Y |z] 2? 
z  (z-1)(z—0.394)(z — 0.174) 
1 0.583 0.083 


S421 z—0394° z—-0.174 
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Hence 


z _ _0.583z 0.083z 
—1 2-0.394 2z-0.174 


Y |z] 


and 
y[k] = 1 — 0.583(0.394)* + 0.083(0.174)* 


This response is depicted in Fig. 11.11. E 
11.6-1 Response Between Sampling Instants: The Modified Z-Transform 


The above analysis yields the output only at sampling instants. We can readily 
find the response between successive sampling instants by using the modified z- 
transform. This goal can be accomplished by considering the response at another 
set of sampling instants t = (k + »)T, where 0 < p <1. 

Consider the system in Fig. 11.10a with H (s) = 1/(s—A). The impulse response 
is h(t) = eò% and its samples at instants t = (k + 4)T are 


h(t, p) = eòFtAT = eòT [eàkT] (11.50a) 
The corresponding z-transfer function is 


AuT 
AT 


z ze 


AT 


H[z, u] = eT (11.50b) 


z—e z—e 


In this manner, We can prepare a table of modified z-transform. When we use 
H{z, u] instead of H [z] in our analysis, we obtain the response at instants t = 
(k + )T. By using different values of » in the range 0 to T, we can obtain the 
complete response y(t). 


E Example 11.10 

Find the output y(t) for all t in Example 11.9. 

In Example 11.9, we found the response y[k] only at the sampling instants. To 
find the output values between sampling instants, we use the modified z-transform. The 
procedure is the same as before, except that we use modified z-transform corresponding 
to continuous-time systems and signals. For the system G(s) = 1/s +4 with T = 0.5, the 
modified z-transform [Eq. (11.50b) with A = —4, and T = 0.5) is 


— eT z _ ae z 
Hiz ase" Sea 70133 


Moreover to find the modified z-transform corresponding to f(t) = u(t) [A = 0 in Eq. 
(11.50a)], we have F[z, u} = z/(z — 1). Substitution of these expressions in those found in 
Example 11.9, we obtain 


z 0.583z 0.083z 


— p7? 
Yiz wl =e Ea z— 0.394 ` z—0.174 
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From Eqs. (11.50), we obtain the inverse (modified) z-transform of this equation as 


yl(k + 2)T] = e7% [1 — 0.583(0.394)* + 0.083(—-0.174)*] O<p<l 
The complete response is also shown in Fig. 11.11. W 


Design of Sampled-Data Systems 


As with continuous-time control systems, sampled-data systems are designed to 
meet certain transient (PO, t,, ts, etc.) and steady-state specifications. The design 
procedure follows along the lines similar to those used for continuous-time systems. 
We begin with a general second-order system. the relationship between closed- 
loop pole locations and the corresponding transient parameters PO, tr, ts,... are 
determined. Hence, for a given transient specifications, an acceptable region in the 
z-plane where the dominant poles of the closed-loop transfer function T[z] should 
lie is determined. Next, we sketch the root locus for the system. The rules for 
sketching the root locus are the same as those for continuous-time systems. If the 
root locus passes through the acceptable region, the transient specifications can be 
met by simple adjustment of the gain K. If not, we must use a compensator, which 
will steer the root locus in the acceptable region. 


11.7 The Bilateral Z-Transform 


Situations involving noncausal signals or systems cannot be handled by the 
(unilateral) z-transform discussed so far. Such cases can be analyzed by the bilat- 
eral (or two-sided) z-transform defined by 


Fi]= >> sikl 
k=—00 


The inverse z-transform is given by 


fle] = ae 


These equations define the bilateral z-transform. The unilateral z-transform dis- 
cussed so far is a special case, where the input signals are restricted to be causal. 
Restricting signals in this way results in considerable simplification in the region of 
convergence. Earlier, we showed that 


z 
*ulk] => prem jz] > Iyl (11.51) 


In contrast, the z-transform of the signal —y*u[—(k + 1)], illustrated in Fig. 11.12a, 
is 
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A 


-yt u [-(k+1)] 


A Region of Convergence 


Fig. 11.12 —+y*u[—(k + 1)] and the region of convergence of its z-transform. 


-1 


-1 
Z {—y*ul-(e +} =A -HA 


Ai 
z 


1 z 
=1-— -|<1 
1 Tz x 
z 
= lz| < iyl 
z= 
Therefore . 
2{-9"ul-@+ Di} = => z ki<hl (11.52) 


A comparison of Eqs. (11.51) with (11.52) shows that the z-transform of y*u[k] is 
identical to that of —y*u[—(k + 1)]. The regions of convergence, however, are dif- 
ferent. In the former case, F [z] converges for |z| > |y|; in the latter, F [z] converges 
for |z| < |y| (see Fig. 11.12b). Clearly, the inverse transform of F{z] is not unique 
unless the region of convergence is specified. If we restrict all our signals to be 
causal, however, this ambiguity does not arise. The inverse transform of z/(z — y) 
is y*u[k] even without specifying the region of convergence. Thus, in the unilat- 
eral transform, we can ignore the region of convergence in determining the inverse 
z-transform of F[z]. 


@ Example 11.11 
Determine the z-transform of 


fik] = (0.9)*ufk] + (1.2)*ul-(& + 1)] 
= fılk] + folk] 
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JIk 
1 
-15 0 15 25 i 
@ k—> N | 
(b) : 
Fig. 11.13 Signal f[k] for Example 11.11. 
From the results in Eqs. (11.51) and (11.52), we have 
Fiz] = — jz] > 0.9 
1a = 7-09 
Fə|z] = = jz] < 1.2 
cage oo) i 
The common region where both Fi[z] and F2{z] converge is 0.9 < |z| < 1.2 (Fig. 11.13a). 
Hence i 
j 
F[2] = Filz] + Falz] 
oe ty 
z-09 2z-1.2 
Bee 0.9 < |z| < 1.2 (11.53) | 


= @—09)(z - 1.2) 


The sequence f[k] and the region of convergence of F/[z] are depicted in Fig. 11.13. 
E 


@ Example 11.12 
Find the inverse z-transform of 


_ —z(z +0.4) 
Fl = Goa -) 


if the region of convergence is (a) |z} >2 (b) |z|<0.8 (c) 0.8< |z| <2. 
F(z] -(z +0.4) 
(a) z -08-2 
ERE Dek eee 
“2-08 2-2 


and | 
| 
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kk 
j 0 5 10 15 
fk 
-5x 10° 
-10 
(a) 
if 
fik 
-10 -5 0 5 10 p> 


(c) 
Fig. 11.14 Three possible inverse transforms of F[z] in Example 11.12. 


Since the region of convergence is |z| > 2, both terms correspond to causal sequences and 
fik} = [(0.8)* — 2(2)*] ula] 


This sequence appears in Fig. 11.14a. 


(b) In this case, |z| < 0.8, which is less than the magnitudes of both poles. Hence, 
both terms correspond to anticausal sequences, and 


fik] = [-(0.8)* + 2(2)"] u [-(k + 1) 
This sequence appears in Fig. 11.14b. 


(c) In this case, 0.8 < |z| < 2; the part of F[z] corresponding to the pole at 0.8 is a 
causal sequence, and the part corresponding to the pole at 2 is an anticausal sequence: 


fik] = (0.8)*ulk] + 2(2)*u[—(k + 1)] 


This sequence appears in Fig. 11.14c. E 
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A Exercise £11.13 
Find the inverse z-transform of 
z 


Fiz] = ——— 
A= syed 


1 
5 > |z)>3 


Answer: 6(-4)Fufk] + 6(—4)*ul-(k+)] y 


Inverse Transform by Expansion of F[z] in Power Series of z 
We have 


Piel = slk] 
k 
For an anticausal sequence, which exists only for k < —1, this equation becomes 


Plz] = f{[-lz + f[-2]z? + f[—3]z3 +--- 


We can find the inverse z-transform of F[z] by dividing the numerator polynomial 
with the denominator polynomial, both in ascending powers of z, to obtain a poly- 
nomial in ascending powers of z. Thus, to find the inverse transform of z/(z — 0.5) 
(when the region of convergence is |z| < 0.5), we divide z with —0.5 + z to obtain 
—2z — 4z? — 823 —.-.. Hence, f[—1] = —2, f[-2] = —4, f[-3] = -8 and so on. 


11.7-1 Analysis of LTID Systems Using the Bilateral Z-Transform 


Because the bilateral z-transform can handle noncausal signals, we can analyze 
noncausal linear systems using this transform. The zero-state response y|k] is given 
by 

vik] = Z~ {F [2] [2}} 


provided that F[z]H[z] exists. The region of convergence of F[z]H[z] is the region 
where both F[z] and H [z] exist, a fact which means that the region is common to 
the convergence of both F[z] and H [z]. 


E Example 11.13 
For a causal system specified by the transfer function 


z 


-0.5 


H[z] = 
find the zero-state response to input 
fik] = (0.8)*ufk] + 2(2)*ul—(k + 1)] 
The z-transform of this signal is found from Example 11.12 (part c) as 


_ _—z(z + 0.4) 
F= oae A 0.8 < |z| <2 


Therefore 
—z*(z + 0.4) 
(z — 0.5)(z — 0.8)(z — 2) 


Y [z] = F[z]H |z] = 
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Since the system is causal, the region of convergence of H [z] is |z| > 0.5. The region of 
convergence of F[z] is 0.8 < |z| < 2. The common region of convergence for F|z] and H[z] 
is 0.8 < |z| < 2. Therefore 


—27(z + 0.4) 
~ (z — 0.5)(z — 0.8)(z — 2) 


Y fz] 0.8 < |z| < 2 


Expanding Y |z] into modified partial fractions yields 


z 8 z 8 z 
7 8 2 
Yiz] stsl) sG) oS silks 


The poles at 0.5 and 0.8 are enclosed within the ring of convergence and therefore cor- 
respond to the causal part, and the pole at 2 is outside the ring of convergence and 
corresponds to the anticausal part of Y [z]. Therefore 


yik] = [-(0.5)* + §(0.8)"] afk] + $(2)"uļ-(k +1) W 


E Example 11.14 
For the system in Example 11.13 find the zero-state response to input 


fik] = (0.8)*ufk] + (0.6)"u[-(k + 1)] 


falk] falk] 


The z-transforms of the causal and anticausal components fı[k] and f2{k] of the output 
are 
z 


Fil] = g >08 
F,[z]=——— sz] < 06 
27 = 2-06 ' 


Observe that a common region of convergence for F} [z] and F2[z] does not exist. Therefore 
F[z] does not exist. In such a case we take advantage of the superposition principle and 
find yi{k] and y2[k], the system responses to fi{k] and f2[k], separately. The desired 
response y[{k] is the sum of yi{k] and y2[k]. Now 


z 


Hie]=— ze > 05 
2? 
Yel=AllMel=—— Gem >O 
Yo[z] = Fo(z|H[z] = =u 0.5 < |z| < 0.6 


{z — 0.5)(z — 0.6) 


Expanding Yi[z] and Y2[z] into modified partial fractions yields 


nida (sas) +3 reos) I> 08 


z z 
Yəlz] 5(—;) s(a) 0.5 < |z| < 0.6 


Therefore 
yilk] = [-$(0.5)* + $(0.8)*] ulk] 


y2{k] = 5(0.5)*ufk] + 6(0.6)*u[—(k + 1)] 
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and 


ylk] = yık} + y2fk] 
= [4P (0.5)" + $(0.8)*] ufk] + 6(0.6)"u[-(k +1) W 


A Exercise E11.14 
For a causal system in Example 11.13, find the zero-state response to input 


FIK] = (2)* ulk} + 5(3)*uf- +] 


Answer: [~(4)* + 3(3)*] ulk] +6(3)*ul-(k+)] y 


11.8 Summary 


In this chapter we discuss the analysis of linear, time-invariant, discrete-time 
(LTID) systems by z-transform. The z-transform is an extension of the DTFT 
with the frequency variable j generalized to o + 39. Such an extension allows us 
to synthesize discrete-time signals by using exponentially growing (discrete-time) 
sinusoids. The relationship of the z-transform to the DTFT is identical to that of 
the Laplace transform to the Fourier. Because of the generalization of the frequency 
variable, we can analyze all kinds of LTID systems and also handle exponentially 
growing inputs. 

The z-transform changes the difference equations of LTID systems into alge- 
braic equations. Therefore, solving these difference equations reduces to solving 
algebraic equations. 

The transfer function H [z] of an LTID system is equal to the ratio of the z- 
transform of the output to the z-transform of the input when all initial conditions 
are zero. Therefore, if F[z] is the z-transform of the input f[k] and Y fz] is the 
z-transform of the corresponding output y[k] (when all initial conditions are zero), 
then Y [z] = H[z]F[z]. For a system specified by the difference equation Q[E]y[k] = 
P [E]f [k], the transfer function H [z] = P[z]/Q[z]. Moreover, H [z] is the z-transform 
of the system impulse response h[k]. We also showed in Chapter 9 that the system 
response to an everlasting exponential z* is H[z]2*. 

LTID systems can be realized by scalar multipliers, summers, and time delays. 
A given transfer function can be synthesized in many different ways. Canonical, 
cascade and parallel forms of realization are discussed. The realization procedure 
is identical to that for continuous-time systems. 

In Sec. 11.5, we showed that discrete-time systems can be analyzed by the 
Laplace transform as if they were continuous-time systems. In fact, we showed that 
the z-transform is the Laplace transform with a change in variable. 

In practice, we often have to deal with hybrid systems consisting of discrete- 
time and continuous-time subsystems. Feedback hybrid systems are also called 
sampled-data systems. In such systems, we can relate the samples of the output to 
those of the input. However, the output is generally a continuous-time signal. The 
output values during the successive sampling intervals can be found by using the 
modified z-transform. 

The majority of the input signals and practical systems are causal. Conse- 
quently, we are required to deal with causal signals most of the time. When all 
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signals are restricted to the causal type, the z-transform analysis is greatly simpli- 
fied; the region of convergence of a signal becomes irrelevant to the analysis process. 
This special case of z-transform (which is restricted to causal signals) is called the 
unilateral z-transform. Much of the chapter deals with this transform. Section 
11.7 discusses the general variety of the z-transform (bilateral z-transform), which 
can handle causal and noncausal signals and systems. In the bilateral transform, 
the inverse transform of F(z] is not unique, but depends on the region of conver- 
gence of F(z]. Thus, the region of convergence plays a crucial role in the bilateral 
z-transform. 


Problems 


11.1-1 Using the definition of the z-transform, show that 


k-1 1 of y/z 
(a)y ujk — 1] <=> == (c) grekl =e 


(b) ulk — m] => /z 


(In a)* 
k! 


ai 1) (d) ulk] <=> a 


11.1-2 Using only the z-transform Table 11.1, show that 


(a) 2**ulk — 1] +e*tulk] => 5 + tS 


yz 
(b) ky*ulk = 1] =] tza 


Hint: Express u[k — 1] in terms of u[k]. 

(c) [2~* cos (5k)] ufk — 1] => ate 

Hint: See the hint for part b. 

(d) k(k — 1)(k — 2)2*-Sulk — m] => Gi for m=0, 1, 2, or 3. 

Hint: Examine what happens to the function if u[k — m] is replaced by ufk]}. 


11.1-3 Find the inverse z-transform of 


(a) Aa (g) ne 

(>) ae (h) a e ae 
Gee op (i) See 
(e) one (k) z?(—22z? + 8z — 7) 


(z = 1)(z — 2)8 
z(1.4z + 0.08) 
(£) (z — 0.2)(z — 0.8)? 


11.1-4 Find the first three terms of f[k] if 


Fie} = 22? 41327 +z 
~ 23472242241 


0 m-l ko 


11.1-5 


11.2-1 


11.2-2 


11.2-3 


11.2-4 


11.3-1 
11.3-2 


11.3-3 


11.3-4 


11.3-5 


11.3-6 
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cats) 


Fig. P11.2-1 


Fig. P11.2-2 


Find your answer by expanding F[z] as a power series in z~?. 


By expanding 
yz 
PA= Ga 


as a power series in z~1, show that f[k] = ky*ulk]. 


For a discrete-time signal shown in Fig. P11.2-1 show that 


l-z7™ 
Fel = Fo 

Find the z-transform of the signal illustrated in Fig. P11.2-2. Solve this problem in 
two ways, as in Examples 11.2d and 11.4. Verify that the two answers are equivalent. 


Using only the fact that ujk] => 5 and properties of the z-transform, find the 
z-transform of 


(a) k?y"ulk] 
(b) k?u[k] 


(c) a" [uk] — ufk - ml] 

(d) ke™’™u[k — m] 

Using only Pair 1 in Table 11.1 and appropriate properties of the z-transform, derive 
iteratively pairs 2 through 9. In other words, first derive Pair 2. Then use Pair 2 


(and Pair 1, if needed) to derive Pair 3, and so on. However, pair 6 should be derived 
after pair 7. 


Solve Prob. 9.4-9 by the z-transform method. 
Solve 
ylk + 1] + 2y[k] = f[k + 1] 
with y[0] = 1 and f[k] = e~®—ufk] 
Find the output y{k] of an LTID system specified by the equation 


2y[k + 2] — 3y[k + 1] + ylk] = 4f[k + 2] — 3f[k + 1] 


if the initial conditions are y{[—1] = 0, y[—2] = 1, and the input f{k] = (4)~*u[k]. 
Solve Prob. 11.3-3 if instead of initial conditions y[—1], y[—2] you are given the aux- 
iliary conditions y{0] = 2 and y{1] = Ž. 
Solve 

Ay[k + 2] + 4y[k + 1] + yik] = f[k + 1] 


ao y[—1] = 0, y[—2] = 1, and f[k] = ufk]. 
olve 
ylk + 2] ~ 3y[k + 1] + 2y[k] = fk + 1] 
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11.3-7 


11.3-8 


11.3-9 


11.3-10 


11.3-11 


11.3-12 


11.3-13 


11.3-14 


11.3-15 


11.4-1 


11.4-2 


if y[~1] = 2, y[—2] = 3, and f{k] = (3)"u[k]. 
Solve 
ylk + 2] — 2yfk + 1] + 2y[k] = ffk] 

with y[—1] = 1, y[—2] = 0, and f[k] = ul]. 
Solve 

yik] + 2y[k — 1) + 2y[k — 2] = f[k — 1] + 2f[k — 2] 
with y{0] = 0, y[1] = 1, and f{k] = e*u[k]. 
(a) Find the zero-state response of an LTID system with transfer function 


z 


Heiz (z + 0.2)(z — 0.8) 


and the input f[k] = e+) ufx]. 
(b) Write the difference equation relating the output y[k] to input f[k]. 
Repeat Prob. 11.3-9 if f{k] = u{k] and 


_ 2z+3 
H= ea a) 
Repeat Prob. 11.3-9 if ( 
6(5z -1 
All = Ga gri 


and the input f[k] is (a) (4)7*ulk] (b) (4)7 >?) ufk — 2] (c) (4)~F-? ula] 
(a) (4)"“*ufk — 2]. 


Repeat Prob. 11.3-9 if f[k] = u[k] and 


2z—1 


All = 3—Ter 408 


Find the transfer functions corresponding to each of the systems specified by difference 
equations in Probs. 11.3-2, 11.3-3, 11.3-5, and 11.3-8. 


Find A[k], the unit impulse response of the systems described by the following equa- 
tions: 

(a) ylk] + 3y[k — 1} + 2y[k — 2] = f[k] + 3f[k — 1] + 3f[k - 2] 

(b) yik + 2] + 2y[k + 1] + yfk] = 2f[k + 2] — fk + 1) 

(c) vik] — y[k — 1] + 0.5y[k — 2] = f{k] + 2f{k — 1] 

Find h[k], the unit impulse response of the systems in Probs. 11.3-9, 11.3-10, and 
11.3-12. 


Show a canonical, a cascade and a parallel realization of the following transfer func- 
tions: 


(a) Alzj= J 
)  HEl= asp ois 
ih. HES 3.8z — 1.1 


(z — 0.2)(z? — 0.6z + 0.25) 

Give cascade and parallel realizations of the following transfer functions: 
z(1.6z — 1.8) z(2z? + 1.3z + 0.96) 

(@) oDe +2405) (>) (405) - 04) 
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11.4-3 


11.4-4 


11.6-1 


11.6-2 


11.6-3 
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f(t) ZN r fH yt) TÄ = 


Fig. P11.6-1. 


Fig. P11.6-2. 


Realize a system whose transfer function is 


x 2z4 + 23 +0.82? +22 +8 


H[) . 


Realize a system whose transfer function is given by 


H|z] = Pe 


k=0 


Determine y{k], the output samples for the system depicted in Fig. P11.6-1 if the 
input f(t) = e7**u(t). 


For the sampled-data system in Fig. P11.6-2, show that the z-transfer function is 
-Cl 
Ti = GEE 


where the transfer function GH [z] corresponds to G(s)H(s) in Table 12.1. 


For the sampled-data system in Fig. P11.6-3, show that the output Y[z] is given by 


FG[z] 

Y[z] = EL 
l= Team 

Note that FG[z] corresponds to the entry for F(s)G(s) in Table 12.1. It is not the 

same as F[z]G[z]. In this case, it is not possible to express the output as Y [z] = 

T|z]F[z]. Consequently, the z-transfer function of such systems does not exist, and 

their analysis is little more complicated. 


Problems Tlo 


11.7-1 


11.7-2 


11.7-3 


11.7-4 


11.7-5 


Fig. P11.6-3. 


Find the z-transform (if it exists) and the corresponding region of convergence for 
each of the following signals: 


(a) (0.8) *u[k}] + 2*u[—(k + 1)] 

(b)  2*ufk] — 3*u[—(k + 1)} 

(c) (0.8)*u[k] + (0.9)*u[—(& + 1)] 
(a) — [(0.8)* + 3(0.4)*] u[—(k + 1)] 
(e) {(0.8)* + 3(0.4)*] u[k] 

(£)  (0.8)*u[k] + 3(0.4)*u[—(k + 1)] 
Find the inverse z-transform of 


(e7? — 2)z 


Fe = Gaye = 3) 


when the region of convergence is 
= ~2 
(a) jz) >2 (b) e*%<|z|<2 (e) lze]<e™. 
Determine the zero-state response of a system having a transfer function 
z 


= af Ss |z| > 0.8 
(z + 0.2)(z — 0.8) 


H[z} 


and an input f[k] given by 

(a) fik] = e"u[k] 

(b) fik] = 2*u[-(k +1) 

(c) fik] = e*ufk] + 2*u[—(k + 1)] 

For the system in Problem 11.7-3, determine the zero-state response if the input 


Fik] = 2*ufk] + ul- (k + D) 
For the system in Problem 11.7-3, determine the zero-state response if the input 


fik] = e7™[-(k +1)] 


Frequency Response and _ 
Digital Filters 


Filtering characteristics of a system are specified by its frequency response. For 
this reason it is important to study frequency response of discrete-time systems 
which is very similar to the frequency response of continuous-time systems with 
some significant differences. 


12.1 Frequency Response of Discrete-Time Systems 


For (asymptotically stable) continuous-time systems we showed that the system 
response to an input e*t is H (jw)er*, and that the response to an input cos wt is 
|H (jw)| cos [wt + ZH (jw)]. Similar results hold for discrete-time systems. We now 
show that for an (asymptotically stable) LTID system, the system response to an 
input en is H[e?™Je7°* and the response to an input cos Qk is |H [e°] cos (Qk + 
ZH[e™). 

The proof is similar to the one used in continuous-time systems. In Sec. 9.4-2 
we showed that an LTID system response to an (everlasting) exponential z* is also 
an (everlasting) exponential H[z]z*. It is helpful to represent this relationship by 
a directed arrow notation as 


z* => H[z]z* (12.1) 

Setting z = e+!® in this relationship yields 
ef => H [t] (12.2a) 
eik > H [e~IMe—INK (12.2b) 


Addition of these two equations yields 
2cos Qk => HfeIMeI% + Ale~IMe-I* = 2Re (# [Me™ (12.3) 
Expressing H|e!"| in the polar form 


Hei) = | Hei He] (12.4) 
Eq. (12.3) can be expressed as 
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cos 2k => |H [e°] cos (sm + Lute) (12.5) 


In other words, the system response y[k] to a sinusoidal input cos Qk is given by 


yik] = |H [e°] cos (o: + cle) (12.6a) 
Following the same argument, the system response to a sinusoid cos (Qk + @) is 
ylk] = |H [et®]] cos (o +0+ LHe) (12.6b) 


This result applies only to asymptotically stable systems because Eq. (12.1) is valid 
only for values of z lying in the region of convergence of H |z]. For z = ez lies 
on the unit circle (|z| = 1). The region of convergence for unstable and marginally 
stable systems does not include the unit circle. 

This important result shows that the response of an asymptotically stable LTID 
system to a discrete-time sinusoidal input of frequency Q is also a discrete-time sinu- 
soid of the same frequency. The amplitude of the output sinusoid is |H [e1®]] times 
the input amplitude, and the phase of the output sinusoid is shifted by LH [e!°) with 
respect to the input phase. Clearly |H [e%®]| is the amplitude gain, and a plot of 
|H [e9] versus 2 is the amplitude response of the discrete-time system. Similarly, 
ZH |e3®| is the phase response of the system, and a plot of ZH{e3®] vs Q shows 
how the system modifies or shifts the phase of the input sinusoid. Note that H [ce] 
incorporates the information of both amplitude and phase response and therefore 
is called the frequency response of the system. 

These results, although parallel to those for continuous-time systems, differ 
from them in one significant aspect. In the continuous-time case, the frequency re- 
sponse is H(jw). A parallel result for the discrete-time case would lead to frequency 
response H [jQ]. Instead, we found the frequency response to be H [e°]. This devi- 
ation causes some interesting differences between the behavior of continuous-time 
and discrete-time systems. 


Steady-State Response to Causal Sinusoidal Input 


As in the case of continuous-time systems, we can show that the response of an 
LTID system to a causal sinusoidal input cos Qk u[k] is y[k] in Eq. (12.6a), plus a 
natural component consisting of the characteristic modes (see Prob. 12.1-4). For a 
stable system, all the modes decay exponentially, and only the sinusoidal component 
in Eq. (12.6a) persists. For this reason, this component is called the sinusoidal 
steady-state response of the system. Thus, Yss[k], the steady-state response of a 
system to a causal sinusoidal input cos Qk u|k], is 


yss(k] = |H fe?” ]| cos (a + me) 


System Response to Sampled Continuous- Time Sinusoids 


So far we have considered the system response of a discrete-time system to a 
discrete-time sinusoid cos 2k (or exponential eJ®k). In practice, the input may be a 
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sampled continuous-time sinusoid cos wt (or an exponential et), When a sinusoid 
cos wt is sampled with sampling interval T, the resulting signal is a discrete-time 
sinusoid cos wkT. Therefore, all the results developed in this section apply if we 
substitute wT for Q: 

Q=wT 


E Example 12.1 
For a system specified by the equation 


ylk + 1] — 0.8y[k] = f[k + 1] 
find the system response to the input (a) 1# =1 (b) cos[Zk — 0.2] 
(c) a sampled sinusoid cos 1500¢ with sampling interval T = 0.001. 


The system equation can be expressed as 


(E — 0.8)y{k] = ES [k] 
Therefore, the transfer function of the system is 
z 1 
Hiz) = ——- = — 
l= 708 7 os 
The frequency response is 
eet ad 
1 — 0.8e—32 
T 1 
1 — 0.8(cos 2 — j sin 2) 
_ 1 
(1 — 0.8cos 2) + j0.8sin Q 


H [e™®| 


(12.7) 


Therefore 
1 
a/ (1 — 0.8 cos 2)? + (0.8sin 2)? 
1 


~ 7.64 — 1.6c0s 2 ae 


pte) = 


and 


— 0.8 cos Q (12.85) 


The amplitude response |H [e?]| can also be obtained by observing that | H |? = HH". 
Therefore 


LH[e?] = -tan™* l Osem i | 


|e)" 


= H|e®]H" [e°] 
= He |H[e-| (12.9) 


From Eq. (12.7) it follows that 


jae = (; = came) (; — aam) 


1 
~ 1.64 — 1.6 cos Q 


which yields the result found earlier in Eq. (12.8). 


12.1 Frequency Response of Discrete-Time Systems 719 


|H fe/*}] 


i aa ia : nig 


-53.13° 


Fig. 12.1 Frequency response of an LTID system in Example 12.1. 


Figure 12.1 shows plots of amplitude and phase response as functions of 2. We now 
compute the amplitude and the phase response for the various inputs: 


(a) flkj=1"=1 
Since 1* = (ef?) with Q = 0, the amplitude response is H[e?°]. From Eq. (12.8) 
we obtain 


=5=540 


1 1 
He] = = 
e] /1.64-— 1.6cos (0) v0.04 


|H[e||=5 and LH{e?") =0 


Therefore 


These values also can be read directly from Figs. 12.1a and 12.1b, respectively, correspond- 
ing to Q = 0. Therefore, the system response to input 1 is 


ylk] = 5(1*) = 5 (12.10) 


(b) fik] = cos [Zk — 0.2] 
Here Q = $. According to Eqs. (12.8) 


Jaje] = = = 1.983 
4/1.64 — 1.6cos = 
. 0.8sin = 
jn/6) _ _ tan 7} | _~_> 8 _ | = —0.916 rad. 
LH[e?*""} tan l: Dawes z| r 


These values also can be read directly from Figs. 12.1a and 12.1b, respectively, correspond- 
ing toN =$- Therefore 
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y [k] 


-u HE 41%]? Tr Tsn 


Fig. 12.2 Sinusoidal input and the corresponding output of an LTID system in Example 
12.1. 


ylk] = 1.983 cos (Zk — 0.2 — 0.916) 
= 1.983 cos (3k — 1.116) (12.11) 


Figure 12.2 shows the input f[k] and the corresponding system response. 


(c) A sinusoid cos 1500t sampled every T seconds (¢ = kT) results in a discrete-time 
sinusoid 


fk] = cos 1500kT (12.12) 
For T = 0.001, the input is 


fik] = cos (1.5k) (12.13) 
In this case, Q = 1.5. According to Eqs. (12.8a) and (12.8b) 


1 
J164- 1.6cos (1.5) 


|El] = 0.809 (12.14) 


LH [e15] ta | = —0.702 rad (12.15) 


0.8 sin (1.5) 
1 — 0.8 cos (1.5) 


These values also could be read directly from Fig. 12.1 corresponding to Q = 1.5. 
Therefore 


y[k] = 0.809 cos (1.5k — 0.702) W 


© Computer Example C12.1 
Using MATLAB, find the frequency response of the system in Example 12.1. 
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num=[1 0]; den=[1 -0.8]; 
W=-pi:pi/100:pi; 
H=freqz(num,den,W); 
mag=abs(H); 
phase=180/pi*unwrap(angle (H)); 
subplot (2,1,1); 

plot(W,mag);grid; 

subplot(2,1,2); 
plot(W,phase);grid © 


Comment 

Figure 12.1 shows plots of amplitude and phase response as functions of Q. 
These plots as well as Eqs. (12.8) indicate that the frequency response of a discrete- 
time system is a continuous (rather than discrete) function of frequency 2. There 
is no contradiction here. This behavior is merely an indication of the fact that the 
frequency variable 2 is continuous (takes on all possible values) and therefore the 
system response exists at every value of 2. 


A Exercise E12.1 
For a system specified by the equation 


ylk + 1] — 0.5y[k] = FIA] 


find the amplitude and phase response. Find the system response to sinusoidal input cos (1000t—- 3) 

sampled every T = 0.5 ms. 

Answer: 3 Š ; a 
|H | = Frater LHe! = ~ tan” [ae B Ss] 


ylk] = 1.639 cos (0.5k — % — 0.904) = 1.639 cos (0.5k — 1.951) V 


A Exercise E12.2 

Show that for an ideal delay (H[z] = 1/z), the amplitude response |H[e3*}| = 1, and the 
phase response LH lef 2) = —Q. Thus, a pure time-delay does not affect the amplitude gain of 
sinusoidal input, but it causes a phase shift (delay) of radians in a discrete sinusoid of frequency 
Q. Thus, in the case of an ideal delay, we see that the phase shift at the output is proportional to 
the frequency of the input sinusoid (linear phase shift). Vv 


The Periodic Nature of the Frequency Response 


Figure 12.1 shows that for the system in Example 12.1, the frequency response 
H[e?®] is a periodic function of Q with period 27. This fact is not a coincidence. 
Unlike the frequency response of a continuous-time system, the frequency response 
of every LTID system is a periodic function of Q with period 27. This fact fol- 
lows from the very structure of the frequency response H [e?°*]. Its argument Jk 
is a periodic function of Q with period 27. This fact will automatically render 
H{e#®*] periodic. There is a physical reason for this periodicity and the periodicity 
of H[e#?*] should not come as a surprise. We know that discrete-time sinusoids sep- 
arated by values of Q in integral multiples of 2r are identical. Therefore, the system 
response to such sinusoids (or exponentials) is also identical. Thus for discrete-time 
systems, we need to plot the frequency response only over the frequency range from 
—n to x (or from 0 to 27r). In a real sense, discrete-time sinusoids of frequencies 
outside the fundamental range of frequencies do not exist (although they exist in a 
technical sense). 
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z- plane 


(b) 


Fig. 12.3 (a) vector representation of complex numbers (b) vector representation of 
factors of H [z]. 


12.2 Frequency Response From Pole-Zero Location 


The frequency response (amplitude and phase response) of a system are deter- 
mined by pole-zero locations of the transfer function Hfz]. Just as in continuous- 
time systems, it is possible to determine quickly the amplitude and the phase re- 
sponse and to obtain physical insight into the filter characteristics of a discrete-time 
system by using a graphical technique. Consider the transfer function 


(z — 21)(z — z2)--+ (z — zn) 
(z = 11)(z = 72) (2 — In) 
We can compute H |z] graphically using the concepts discussed in Sec. 7.3. The 
directed line segment from z; to z in the complex plane (Fig. 12.3a) represents the 
complex number z — z;. The length of this segment is |z — z;| and its angle with the 
horizontal axis is (z — z;). 

In filtering applications, the inputs are often the sampled continuous-time sinu- 
soids. Earlier, we showed that a sampled continuous-time sinusoid cos wt appears 
as a discrete-time sinusoid cos Qk (Q = wT). The appropriate function for com- 
puting the frequency response in such a situation, therefore, is H [eT] (Q = wT). 
To compute the frequency response H [e#“T] we evaluate H [z] at z = e?”7. But for 
z= eT |z| = 1 and Zz = wT so that z = e)”7 represents a point on the unit circle 
at an angle wT with the horizontal. We now connect all zeros (z, 22, --.) Zn) and 
all poles (y1, Y2, ---; Yn) to the point eJ#T as indicated in Fig. 12.3b. Let ri, T2, 
..., Tn be the lengths and 41, ¢2, - -- n be the angles, respectively, of the straight 


Az] = bn (12.16) 


os Saat 
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lines connecting z1, 22, .-.; Zn to the point e/”7. Similarly, let d1, d2, .-., dn be the 
lengths and 01, 82, - - -, On be the angles, respectively, of the lines connecting 71, Y2, 
-.., Yn to FF, Then 


(riet )(r2e1%2) ee (rnet?) 
(drei (dze) (dye) 


=p, TUR Tm ili dat thn) (GtOt+0n)} (12.18) 


H [eT] = H{z]|, esor = bn (12.17) 


dido- -dn 
Therefore 
, Tyra? 
lle = be Teas 
na eT cas 
and 


LH [eF#7] = (1 + 62 +n) — (01 +82 +: + On) 


= sum of zero angles to eJ“T — sum of pole angles to eT (12.19b) 


In this manner, we can compute the frequency response H [e?”7] for any value of w 
by selecting the point on the unit circle at an angle wT corresponding to that value 
of w. This point is e/”7. In summary, to compute the frequency response H fes#T], 
we connect all poles and zeros to this point and determine |H [eT ]| and ZH fet”T] 
using the above equations. We repeat this procedure for all values of wT from 0 to 
mr to obtain the frequency response. 


Controlling Gain by Placement of Poles and Zeros 


The nature of the influence of pole and zero locations on the frequency response 
is similar to that observed in continuous-time systems with a minor difference. In 
place of the imaginary axis of the continuous-time systems, we have a unit circle in 
the discrete-time case. The nearer the pole (or zero) is to a point e/”7 (on the unit 
circle) representing some frequency w, the more influence that pole (or zero) wields 
on the amplitude response at that frequency because the length of the vector joining 
that pole (or zero) to the point eJ#T is small. The proximity of a pole (or zero) has 
similar effect on the phase response. From Eq. (12.19a), it is clear that to enhance 
the amplitude response at a frequency w we should place a pole as close as possible 
to the point eJ”T (on the unit circle) representing that frequency w. Similarly, to 
suppress the amplitude response at a frequency w, we should place a zero as close 
as possible to the point e3“T on the unit circle. Placing repeated poles or zeros will 
further enhance their influence. 

Total suppression of signal transmission at any frequency can be achieved by 
placing a zero on the unit circle at a point corresponding to that frequency. This is 
the principle of the notch (bandstop) filter. 

Placing a pole or a zero at the origin does not influence the amplitude response 
because the length of the vector connecting the origin to any point on the unit 
circle is unity. However, a pole (a zero) at the origin generates angle —wT (wT) in 
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ideal 


(e) 
Fig. 12.4 Various pole-zero configurations and the corresponding frequency response. 


LH [eT]. The phase spectrum —wT is a linear function of frequency and there- 
fore represents a pure time-delay of T seconds (see Eq. (10.48) or Exercise E12.2). 
Therefore, a pole (a zero) at the origin causes a time delay (time advance) of T 
seconds in the response. There is no change in the amplitude response. 
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For a stable system, all the poles must be located inside the unit circle. The 
zeros may lie anywhere. Also, for a physically realizable system, H [z] must be 
a proper fraction, that is, n > m. If, to achieve a certain amplitude response, 
we require m > n, we can still make the system realizable by placing a sufficient 
number of poles at the origin. This will not change the amplitude response but it 
will increase the time delay of the response. 

In general, a pole at a point has the opposite effect of a zero at that point. 
Placing a zero closer to a pole tends to cancel the effect of that pole on the frequency 
response. 


Lowpass Filters 


A lowpass filter has a maximum gain at w = 0, which corresponds to point 
eT — 1 on the unit circle. Clearly, placing a pole inside the unit circle near the 
point z = 1 (Fig. 12.4a) would result in a lowpass response. The corresponding 
amplitude and phase response appears in Fig. 12.4a. For smaller values of w, the 
point eT (a point on the unit circle at an angle wT) is closer to the pole, and con- 
sequently the gain is higher. As w increases, the distance of the point eT from the 
pole increases. Consequently the gain decreases, resulting in a lowpass characteris- 
tic. Placing a zero at the origin does not change the amplitude response but it does 
modify the phase response, as illustrated in Fig. 12.4b. Placing a zero at z = —1, 
however, changes both the amplitude and phase response (Fig. 12.4c). The point 
z = —1 corresponds to frequency w = n/T (z =e!” = ef" = —1). Consequently, 
the amplitude response now becomes more attenuated at higher frequencies, with 
a zero gain at wT = 7. We can approach ideal lowpass characteristics by using 
more poles staggered near z = 1 (but within the unit circle). Figure 12.4d shows 
a third-order lowpass filter with three poles near z = 1 and a third-order zero at 
z = —1, with corresponding amplitude and phase response. For an ideal lowpass 
filter we need an enhanced gain at every frequency in the band (0, wc). This can 
be achieved by placing a continuous wall of poles (requiring an infinite number of 
poles) opposite this band. 


Highpass Filters 


A highpass filter has a small gain at lower frequencies and a high gain at 
higher frequencies. Such a characteristic can be realized by placing a pole or poles 
near z = —1 because we want the gain at wT = 7m to be the highest. Placing a 
zero at z = 1 further enhances suppression of gain at lower frequencies. Figure 
12.4e shows a possible pole-zero configuration of the third-order highpass filter with 
corresponding amplitude and phase response. 


@ Example 12.2: Bandpass Filter 

Using trial-and-error, design a tuned (bandpass) filter with zero transmission at 0 
Hz and also at 500 Hz. The resonant frequency is required to be 125 Hz. The highest 
frequency to be processed is Fa = 500 Hz. 

Because Fan = 500, we require T < id [see Eq. (8.17)]. Let us select T = 107°. 
Since the amplitude response is zero at w = 0 and w = 10007, we need to place zeros at 
eT corresponding to w = 0 and w = 10007. For w = 0,2 = eT = 1; for w = 10007 
(with T = 107°), 7 = —1. Hence, there must be zeros at z = +1. Moreover, we need 
enhanced frequency response at w = 2507. This frequency (with wT = 71/4) corresponds 
to z = eT = ef"/4, Therefore, to enhance the frequency response at this frequency, we 
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Fig. 12.5 Designing a bandpass filter in Example 12.2. 


place a pole in its vicinity (near e’"/4). Because this is a complex pole we also need its 
conjugate near e73™/4 as indicated in Fig. 12.5a. Let us choose these poles A; and Az as 


` = fyl" and d2= lye 27/4 


where |y] < 1 for stability. The closer the value of || is to the unit circle, the more sharply 
peaked is the response around w = 2507. We also have a zeros at +1. Hence 


—1)(z +1) 27-1 

H[z]=K (2 — 12.20 
(z — |rle**/4)(z — |yle~97/4) z? — V2lr|z + by? oo 

For convenience we shall choose K = 1. The amplitude response is given by 

Jate] — lT -1l 
Jeet fjera] eT — Tle 774 
Now, using Eq.(12.9), we obtain 
Lae 2(1 — cos 2wT 

jajn? = Geet) (12.21) 


[1 + |y|? — 2ļyļ cos (wT - 3) (i + Iyl? — ly] cos (uT + zj] 
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Figure 12.5b shows the amplitude response for values of |y| = 0.83, 0.96, and 1. As 
expected, the gain is zero at w = 0 and at 500 Hz (w = 10007). The gain peaks at about 
125 Hz (w = 2507). The resonance (peaking) becomes pronounced as |y| approaches 1. 
Fig. 12.5c shows a canonical realization of this filter [see Eq. (12.20)]. a 


© Computer Example C12.2 
Using MATLAB, find the frequency response of the bandpass filter in Example 12.2 
for |y| = 0.96. 


gamma=0.96; 

num=(l1 0 -1]; den=[1 -sqrt(2)*gamma gamma‘ 2}; 
W=-pi:pi/100:pi; 

H=freqz(num,den,W); 

mag=abs(H); 

phase=180/pi*unwrap(angle(H)); 

subplot(2,1,1) 

plot(W,mag) 

subplot(2,1,2) 

plot(W,phase) ©) 


E Example 12.3: Notch (Bandstop) Filter 

Design a second-order notch filter to have zero transmission at 250 Hz and a sharp 
recovery of gain to unity on both sides of 250 Hz. The highest significant frequency to be 
processed is Fan = 500 Hz. 

In this case, T < 1/2Fp = 1073. Let us choose T = 107%. For the frequency 
250 Hz, wT = 2n(250)T = 1/2. Thus, the frequency 250 Hz is represented by a point 
eT = ei*/2 = j on the unit circle, as depicted in Fig. 12.6a. Since we need zero 
transmission at this frequency, we must place a zero at z = e!"/? = j and its conjugate at 
z = e7i"/2 = —j. We also require a sharp recovery of gain on both sides of frequency 250 
Hz. To accomplish this goal, we place two poles close to the two zeros in order to cancel 
out the effect of the zeros as we move away from the point j (corresponding to frequency 
250 Hz). For this reason, let us use poles at tja with a < 1 for stability. The closer the 
poles are to the zeros (the closer the a to 1), the faster is the gain recovery on either side 
of 250 Hz. The resulting transfer function is 

(z—j)(2+3) +l 


Hil = KC jaje t ja)“ +a 


The dc gain (gain at w = 0, or z = 1) of this filter is 


H{i]=K 


2 
1+ a? 


P z : 2 Hoa 
Because we require a dc gain of unity, we must select K = ite, The transfer function is 


therefore 
(1 +.a?)(z? +1) 


HG) 2(z? + a?) 


(12.22) 
and according to Eq. (12.9) 


_ (14a) (eT +1)(e 7T +1) (1 +.a?)?(1 + cos 2wT) 
~ 4 (00T 4 a?)(e iT +a?) 2(1 + a4 + 2a? cos QT) 


|Hfe™]|? 
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Fig. 12.6 Designing a notch (bandstop) filter in Example 12.3. 


Figure 12.6b shows |H{e?“"]| for values of a = 0.3, 0.6, and 0.95. Figure 12.6c shows 
a realization of this filter. W 


A Exercise E12.3 
Using the graphical argument, show that a filter with transfer function 


z-0.9 


H{z] = 


acts as a highpass filter. Make a rough sketch of the amplitude response. Y 
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12.3 Digital Filters 


Digital filters and some of their advantages were discussed in Sec. 8.5. Digital 
filters can be classified as either recursive or nonrecursive. 


Recursive Filters 
The terms recursive and nonrecursive are easily understood in terms of a spe- 
cific example. Consider a third-order system with the transfer function 


b3z3 + baz? + byz + bo 
z3 + a2z? + az +49 


A[z] = (12.23) 
The input f [k] and the corresponding output y[k] of this system are related by the 
difference equation. 


ylk] + azy[k — 1] + aiy[k — 2] + aoy[k — 3] = 
b3f(k] + bof [k — 1) + bif(k — 2] + bof[k — 3] (12.24a) 


or 


ylk] = —a2y[k — 1] — azy[k — 2] — aoy[k — 3] 
output terms 
+ baf [k] + bof (k — 1] + bif[k — 2] + bof [k — 3] (12.24b) 
I, 


input terms 


Here y[k], the output at instant k, is determined by the input values f[k], f[k — 1], 
fik — 2], and f[k — 3] as well as by the past output values y{k — 1], y[k — 2], and 
ylk — 3]. The output is therefore determined iteratively or recursively from the its 
past values. To compute the present output of this third-order system, we use the 
past three values of the output. In general, for an nth-order system we use the past 
n values of the output. Such a system is called a recursive system. 

An interesting feature of a recursive system is that once an output exists, it 
tends to propagate itself forever because of its recursive nature. This is also seen 
from the canonical realization of H [z] in Fig. 12.7a. Once an input (any input) is 
applied, the feedback connections loop the output continuously back into the system, 
and the output continues forever. This propagation of the output in perpetuity 
occurs because of the nonzero values of coefficients a0, a1, a2, ---, @n-1- These 
coefficients [appearing in the denominator of H [z] in Eq. (12.23)] are the recursive 
coefficients. The coefficients bp, b1, 62, ---, bn (appearing in the numerator of 
H{z]) are the nonrecursive coefficients. If an input 6 [k] is applied at the input 
of a recursive filter, the response h{k] will continue forever up to k = oo. For this 
reason, recursive filters are also known as infinite impulse response (IIR) filters. 


730 12 Frequency Response and Digital Filters 


(b) 


Fig. 12.7 Digital filter realization: (a) recursive filter (b) nonrecursive filter. 
Nonrecursive Filters 


If the recursive coefficients ag, a1, and a2 are zero, H |z] in Eq. (12.23) reduces 
to 


= b3z3 + baz?biz + bo 


H [z] a (12.25a) 
bo by bo 
=b 
gto tots (12.25b) 


The difference equation corresponding to this system now reduces to 


ylk] = bsf [k] + bof [k — 1] + bi f[k — 2] + bof [k - 3] (12.26) 


Note that y[k] is now computed from the present and the three past values of the 
input f{k]. Such filters are called nonrecursive filters. Figure 12.7b shows a 
canonical realization of H |z], which is identical to the realization in Fig. 12.7a, with 
all the feedback connections eliminated. If we apply an input f[k] = 6[k] to this 


ee —— 


12.4 Filter Design Criteria 731 


system, the input will pass through the system and will be completely out of the 
system by k = 4. There are no feedback connections to perpetuate the output. 
Therefore, h[{k] will be nonzero only for k = 0, 1, 2, and 3. For an nth-order 
nonrecursive filter, h[k] is zero for k > n. Therefore, the duration of h[k] is finite for 
a nonrecursive filter. For this reason, nonrecursive filters are also known as finite 
impulse response (FIR) filters. Nonrecursive filters are a special case of recursive 
filters, in which all the recursive coefficients ao, a1, @2, .--, @n—1 aTe Zero. 

An nth-order nonrecursive filter transfer function is given by (ao = a1 = a2 = 


+++ = an-1 = 0). 
Hi] = bnz” + owes +++ biz + bo (12.272) 
= bat ast + a3? feeb = + 3 (12.27b) 
The inverse z-transform of this equation yields 
h[k] = bnd[k] + bn-1ôfk — 1] +--+ + b16[k — n + 1] + bod[k — n] (12.28) 


Observe that h|k] = 0 for k > n. 

Because nonrecursive filters are a special case of recursive filters, we expect the 
performance of recursive filters to be superior. This expectation is true in the sense 
that a given amplitude response can be achieved by a recursive filter of an order 
smaller than that required for the corresponding nonrecursive filter. However, non- 
recursive filters have the advantage of having linear phase characteristics. Recursive 
filters can realize linear phase only approximately. 


12.4 Filter Design Criteria 


A digital filter processes discrete-time signals to yield a discrete-time output. 
Digital filters can also process analog signals by converting them into discrete-time 
signals. If the input is a continuous-time signal f (t), it is converted into a discrete- 
time signal f{k] = f(kT) by a C/D (continuous-time to discrete-time) converter. 
The signal f [k] is now processed by a “digital” (meaning discrete-time) system with 
transfer function H [z]. The output y{k] of H [z] is then converted into an “analog” 
(meaning continuous-time) signal y(t). The system in Fig. 12.8a, therefore, acts as 
a continuous-time (or “analog”) system. Our objective is to determine the “digital” 
(discrete-time) processor H [z] that will make the system in Fig. 12.8a equivalent to 
a desired “analog” (continuous-time) system with transfer function H,(s), shown 
in Fig. 12.8b. 

We may strive to make the two systems behave similarly in the time-domain or 
in the frequency-domain. Accordingly, we have two different design procedures. Let 
us now determine the equivalence criterion of the two systems in the time-domain 
and in the frequency-domain. 


12.4-1 The Time-Domain Equivalence Criterion 


By time-domain equivalence we mean that for the same input f(t), the output 
y(t) of the system in Fig. 12.8a is equal to the output y(t) of the system in Fig. 
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Fig. 12.8 Analog filter realization with a digital filter. 


12.8b. Therefore y(kT), the samples of the output in Fig. 12.8b, are identical to 
ylk], the output of H [z] in Fig. 12.8a. 
The output y(t) of the system in Fig. 12.8b ist} 


y(t) = [. f(r)ha(t — 7) dr 


An integral is a sum in the limit. Therefore, the above equation can be expressed 
as 


v(t) = lim | X f(mAr)ha(t — mAr)Ar (12.29a) 


For our purpose it is convenient to use the notation T for Ar in the above equation. 
Such a change of notation yields 


y(t) = iim T 5 f(mT )ha(t — mT) (12.29b) 


m=--0o 


The response at the kth sampling instant is y(kT) obtained by setting t = kT in 
the above equation: 


y(kT) = lim T XO f(mT)hal(k - m)T] (12.29c) 


m=— o0 


In Fig. 12.8a, the input to H [z] is f (kT) = f [k]. If A[k] is the unit impulse response 
of H [z], then y[k], the output of H [z], is given by 


ulk] = $ ffmJr[e — m] (12.30) 


m=—co 


}For the sake of generality, we are assuming a noncausal system. The argument and the results 
are also valid for causal systems. 
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If the two systems are to be equivalent, y(kT) in Eq. (12.29c) must be equal to yfk] 
in Eq. (12.30). Therefore 


alk] = lim Tha(kT) (12.31) 


This is the time-domain criterion for equivalence of the two systems. according to 
this criterion, h{k], the unit impulse response of H [z] in Fig. 12.8a, must be equal 
to T times the samples of h(t), the unit impulse response of the system in Fig. 
12.8b, assuming that T — 0. This is known as the impulse invariance criterion 
of filter design. 


12.4-2 The Frequency-Domain Equivalence Criterion 


In Sec. 2.4-3 [Eq. (2.47)], we proved that for an analog system with transfer 
function H,(s), the system response y(t) to the everlasting exponential input f(t) = 
e* is also an everlasting exponential 


y(t) = Ha(s)e* (12.32) 


Similarly, in Eq. (9.57a), we showed that for a discrete-time system with transfer 
function H [z], the system response y[k] to an everlasting exponential input f[k] = z* 
is also an everlasting exponential H[z]z*: 


ylk] = H[z]z* (12.33) 
If the systems in Figs. 12.8a and 12.8b are equivalent, then the response of both 
systems to an everlasting exponential input f(t) = e% should be the same. A 
continuous-time signal f(t) = e% sampled every T seconds results in a discrete- 
time signal 
fik] = esT 


k 


=z with z = e'f 


This discrete-time exponential z* is applied at the input of H [z] in Fig. 12.8a, whose 
response is 


yik] = H[z]2*| 


z=eťT 


= He" Je? (12.34) 

Now, for the system in Fig. 12.8b, y(kT), the kth sample of the output y(t) in Eq. 
(12.32), is 

y(kT) = Ha(s)e**? (12.35) 


If the two systems are to be equivalent, a necessary condition is that y[k] in Eq. 
(12.34) must be equal to y(kT) in Eq. (12.35). This condition means that 


H [eT] = H.(s) (12.36) 


This is the frequency-domain criterion for equivalence of the two systems. It should 
be remembered, however, that with this criterion we are ensuring only that the 


}Because T is a constant, some authors ignore the factor T, which yields alternate criterion 
hik] = ha(kT). Ignoring T merely scales the amplitude response of the resulting filter. 
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digital filter’s response matches exactly that of the desired analog filter at sampling 
instants. If we want the two responses to match at every value of t, we must have 
T — 0. Therefore 


lim H [eT] = Ha(s) (12.37) 


A Practical Difficulty 


Both of these criteria for filter design require the condition T — 0 for real- 
izing a digital filter equivalent to a given analog filter. However, this condition is 
impossible in practice because it necessitates an infinite sampling rate, resulting 
in an infinite data rate. In practice, we must choose a small but nonzero T to 
achieve a compromise between the two conflicting requirements, namely closeness 
of approximation and system cost. 

This approximation, however, does not mean that the system in Fig. 12.8a 
is inferior to that in Fig. 12.8b, because often H,(s) itself is an approximation 
to what we are seeking. For example, in lowpass filter design we strive to design 
a system with ideal lowpass characteristics. Failing that, however, we settle for 
some approximation such as Butterworth lowpass transfer functions. In fact, it is 
entirely possible that H[z], which is an approximation to Ha(s), may be a better 
approximation to the desired characteristics than is Hq(s) itself. 


12.5 Recursive Filter Design by the Time-Domain Criterion: 
The Impulse Invariance Method 


The time-domain design criterion for the equivalence of the systems in Figs. 
12.8a and 12.8b is [see Eq. (12.31)] 


hk] = lim Tha(kT) (12.38) 


where h{k] is the unit impulse response of H {z}, ha(t) is the unit impulse response 
of H,(s), and T is the sampling interval in Fig. 12.8a. 

As indicated earlier, it is impractical to let T — 0. In practice, T is chosen 
to be small but nonzero. We have already discussed the effect of aliasing and the 
consequent distortion in the frequency response caused by nonzero T. Assuming 
that we have selected a suitable value of T, we can ignore the condition T — 0, and 
Eq. (12.38) can be expressed as 


h{k] = Tha(kT) (12.39) 


The z-transform of this equation yields 


Hz] =TZ (raar) (12.40) 


This result yields the desired transfer function H [z]. 
Let us consider a first-order transfer function 


H,(s) = (12.41a) 


| 
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Fig. 12.9 Procedure for the impulse invariance method of filter design. 


The impulse response h(t) of this filter is the inverse Laplace transform of Ha(s), 


which in this case is 
h(t) = ce**u(t) (12.41b) 


The corresponding digital filter unit sample response h[k] is given by Eq. (12.39) 


h{k] = Tha(kT) = Tce? (12.42) 


Figures 12.9a and b show ha(t) and h[k]. According to Eq. (12.40), H [z] is T times 
the z-transform of h{k]. Thus, 


Tez 
H|z] = z eT (12.43) 


The procedure of finding H [z] can be systematized for any nth-order system. First 
we express an nth-order analog transfer function H a(s) as a sum of partial fractions 


as 


n 
a 
H.(s)= >> : — x (12.44) 
i=1 r 
Then the corresponding H [z] is given by 
A cz 
H(z]=T) aT (12.45) 
i=l 


This transfer function can be readily realized as a parallel combination of the n first- 
order systems if all the n poles of Ha(s) are real. The complex conjugate poles, ìf 
any, must be realized as a single second-order term. Table 12.1 lists several pairs of 
H,(s) and their corresponding H [z]. 


Choosing the Sampling Interval T 


If Fp is the highest frequency to be processed, then the sampling interval must 
be no greater than 1/27) in order to avoid signal aliasing. However, in the impulse 
invariance method, there is yet another consideration, which must also be taken into 
account. Consider a hypothetical frequency response Ha(jw) (Fig. 12.10a) that we 
wish to realize using a digital filter, as illustrated in Fig. 12.8a. Let us assume that 
we have an equivalent digital filter that meets the time-domain equivalence criterion 
in Eq. (12.37); that is , 


z2 — (2e-°T cos bT )z + e~24F 


T?zeòT 
(z Er eAT)2 


Tz 


T32(z +1) 

2(z — 1) 

z — eòT 

Trz [z cos 8 — e~*7 cos (bT — 8)] 


TK 
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Tre~**T cos (bkT + 0) 


h[k] 

TK ôlļk) 
Tulk] 
kT? 

kT 2eAkT 


TABLE 12.1 


re cos (bt + 6) 


ha(t) 
K&(t) 
u(t) 


ert 
tert 
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Ha (j@) 


(a) 


Fig. 12.10 Aliasing in digital filters, and a choice of the sampling interval T. 


h{k] = lim Tha(kT) 


In Chapter 5 (Fig. 5.6), we showed that the Fourier transform of the samples of ha(t) 
consists of periodic repetition of Ha(jw) with period equal to the sampling frequency 
ws = 2n/T = 2nF,.t Also Ha(jw) is not generally bandlimited. Hence, aliasing 
among various repeating cycles cannot be prevented, as depicted in Fig. 12.10b. The 
resulting spectrum will be different from the desired spectrum, especially at higher 
frequencies. If Ha(jw) were to be bandlimited; that is, if H, (jw) = 0 for |w] > wo, 
then the overlap could be avoided if we select the period 2r/T > 2wọ. However, ac- 
cording to the Paley-Wiener criterion [Eq. (4.61)], every practical system frequency 
response is nonbandlimited, and the cycle overlap is inevitable. However, for fre- 
quencies beyond some wọ, if |Ha(jw)| is a negligible fraction, say 1%, of Ha(jw)|max: 
then we can consider! H,(jw) to be essentially bandlimited to wo, and we can select 


p= (12.46) 


E Example 12.4 
Design a digital filter to realize the first-order analog lowpass Butterworth filter with 


the transfer function 
We 
S+We 


H.(s) = we = 10° (12.47) 


{How can we apply the discussion in Chapter 5, which applies to impulse samples of continuous- 
time signals, to discrete-time signals? Recall our discussion in Sec. 10.4 (Fig. 10.8), where we 
showed that the spectrum of discrete-time signal is just a scaled version of the spectrum of the 
impulse samples of the corresponding continuous-time signal. 
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For this filter, we find the corresponding H |z] according to Eq. (12.43) (or pair 5 in Table 
12.1) as 

Welz 
z — ene? 


H[z] = (12.48) 


Next, we select the value of T according to Eq. (12.46). We find the essential filter 
bandwidth wo, where the filter gain is 1% of the maximum filter gain. Here we use 


We 
Vw? + we 


In this case |Ha(jw)|max = 1. Hence, the essential bandwidth wo is that frequency where 
the |H a(jwo)| = 0.01. Observe that 


|Ha(jw)| = 


|Ha(jw)| = = w> We 
Ww 
Hence, 
|Haljwo)| ~ = =0.01 =  wo= 100w. = 10" 
o 
Thus, for good results, we should select T = = = 107r. However, for the sake of 


demonstrating aliasing effect of the overlapping cycles, we shall deliberately select a lower 
value of wo (higher T). Let us select 


= ({—_})-=10°° a 
T (=) 10°r and wT 10 (12.49) 


Substitution of this value in Eq. (12.48) yields 
S125 
z — 0.7304 


A canonical realization of this filter is shown in Fig. 12.11a by following the procedure in 
Sec. 11.4 (see Example 6.18c, Fig. 6.25b). Note the recursive nature of the filter. To find 
the frequency response of this digital filter, we rewrite H [z] as 


H{z] = (12.50) 


0.3142 
H(z] = —— 
el = ionom 
Therefore 
Hett] = — 23142 0.3142 
1—0.7304e-3+T ~ (1 — 0.7304 cos wT) + j0.7304sin wT 
Consequently 
JE let] _ 0.3142 0.3142 


„/(1 — 0.7304 cos wT)? + (0.7304sin wT)? V1.533 — 1.4608 cos wT 


LH{ei*7} £2 pant ( 0.7304 sin wT ) 


1 — 0.7304 cos wT 


Substituting T = m x 10~® in the above equations, we obtain 


|H{e*7)| = oe (12.51a) 
4/ 1.533 — 1.4608 cos (a x 10-%w) 
; 2 0.7304 sin (x x 1076w) 
LHle*7) = 1 12.51b 
fe" ] = — tan” | T= 0.7304 c08 (r x 106w) (12.510) 
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|H[eJ@T}] 


(c) 


Fig. 12.11 An example of filter design by the impulse invariance method: (a) filter 
realization (b) amplitude response (c) phase response. 


Also, according to Eq. (12.47) (with we = 10°) 


10° 


pa ea (12.52) 
jw+we jw +105 


Ha(jw) = 


Therefore 
; 10° oe = 
|Ha(jw)| = Vota 10 and ZH,(jw) = — tan 


Figures 12.11b and 12.11c show the amplitude and phase response of the analog and the 
(normalized)} digital filter over the frequency range 0 < w < n/T = 10°. Observe that 


w 
105 


{The frequency response H [eT] is higher than the desired frequency response Ha Gw) because of 
aliasing. We can partially correct this difference by multiplying H[z] with a normalizing constant, 
forcing the resulting H{e%“7] to be equal to Ha(jw) at w = 0. The normalizing constant K is 
defined as the ratio of Ha(j0) to H[e?°] = H[1J, which in this case is 1/1.653 = 0.858. The 


normalized amplitude response in Fig. 12.11b is that of 0.858 (a) 
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the behavior of the analog and the digital filter is very close over the range w < ws = 10°. 
However, for higher frequencies, there is considerable aliasing, especially in the phase 
spectrum. | 


© Computer Example C12.3 

Using MATLAB, find the impulse invariance digital filter to realize the first-order 
analog Butterworth filter in Example 12.4. 

The analog filter transfer function is 10°/(s + 10°) and the sampling interval T = 
10~®x. A suitable MATLAB function to solve this problem is ‘impinvar’. The input 
data are the coefficients of the numerator and the denominator polynomials of A, (s) 
{entered as (n + 1)-element vectors num and den] and the sampling interval T. MATLAB 
returns b and a, the numerator and the denominator polynomial coefficients of the desired 
digital filter H [z}. 

In designing impulse invariance filter, we use the criterion h[k] = Tha(kT) in Eq. 
(12.39), whereas most books, including MATLAB, use the criterion h[k] = ha(kT). Hence, 
out answer will be T times the answer returned by MATLAB. To correct this discrepancy, 
we multiply num by T. 


T=pi/10°6; num=T*(0 10°5]; den=[1 1075]; 
Fs=1/T; 
[b,a]=impinvar(num,den,Fs) 
MATLAB returns b=0.3142 and a=1 -0.7304. Therefore 
0.31422 

Ale] = 797304 
a conclusion which agrees with our result in Eq. (12.50). To plot the amplitude and the 
phase response, we can use the last 8 functions in Example C12.1. © 


A Exercise E12.4 
Design a digital filter to realize an analog transfer function 
20 
s+ 20 


H(s) = 


Answer: H[z] = Tir with T= 3555 V 
Limitations of the Impulse Invariance Method 

The impulse invariance method is handicapped by aliasing. Consequently this 
method can be used to design filters where H,(jw) becomes negligible beyond some 
frequency B Hz. This condition restricts the procedure to lowpass and bandpass 
filters. The impulse invariance method cannot be used for highpass or bandstop 
filters. Moreover, to reduce aliasing effects the sampling rate has to be very high, 
which makes its implementation costly. In general, the frequency-domain method 
discussed in the next section is superior to this method. 


12.6 Recursive Filter Design by the Frequency-Domain Criterion: 
The Bilinear Transformation Method 


The bilinear transformation method discussed in this section is preferable to 
the impulse invariance method in filtering problems where the gains are constant 
over certain bands (piecewise constant amplitude response). This condition exists in 
lowpass, bandpass, highpass, and bandstop filters. Moreover, this method requires 


7 
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a lower sampling rate compared to the impulse invariance method because of the 
absence of aliasing. In addition, the filter rolloff characteristics are sharper with 
this method compared to those obtained using the impulse invariance method. The 
absence of aliasing is the result of one-to-one mapping from s plane to z plane 


inherent in this method. 
The frequency-domain design criterion is [see Eq. (12.37)] 


lim H [eT] = Ha(s) (12.53) 
T—0 


Let us consider the following power series for the hyperbolic tangent (see Sec. B.7-3) 


= 3 5 
ahh ENE pee te ee) ee ($) +- (12.54) 
2) esT/24 e~sT/2 2 3\2 15 \ 2 
For small T (T — 0), we can ignore the higher-order terms in the infinite series on 
the right-hand side to yield 


lim 


est /2 e78T/2 sT 
T-0 ( ) z 


esT/2 + e—sT/2 pi 


Therefore, as T — 0 
2 est /2 BA e78T/2 
o (3) esT/2 4 e-sT/2 
E eT -1 
AT) eT 41 


Equation (12.53) now can be expressed as 


2 eT -1 
sT] = 22 12.55a) 
Hale =n (2 75) ( 
From this result, it follows that 
22-1 
a 2 12.55b) 
H|] = Ha G <=) ( 
= H,(s)|,=2 zzl (12.55c) 


Therefore, we can obtain H [z] from Ha(s) by using the transformation} 


pats (12.57) 
Tj) z+ 


This transformation is known as the bilinear transformation. 


} There exist other transformations, which can be used to derive H{z] from Ha(s). We start with 
the power series 
eT =1~sT + 4(sT)? -4 (sT? +- 
In the limit as T — 0, all but the first two terms on the right-hand side can be ignored. This 
yields 
s= +a —eT) 


This results in a transformation 
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Choice of T in Bilinear Transformation Method 


Because of the absence of aliasing in the bilinear transformation method, the 
value of the sampling interval T can be much smaller compared to the impulse 
invariance method. By absence of aliasing we mean only the kind of aliasing ob- 
served in impulse invariance method (Fig. 12.10b). The signal aliasing, which limits 
the highest usable frequency, is still present. Thus if the highest frequency to be 
processed is Fp Hz, then to avoid signal aliasing, we must use [see Eq. (8.17c)] 


T< — (12.58) 


@ Example 12.5 
Using the bilinear transformation, synthesize 


Ha(s) = E we = 10° 
From Eq. (12.57), we obtain 
Ae] = ya 
(rar) + 
weT(z +1) 


= 24 uT) — (2— wT) 


We should use Eq. (12.58) to select a suitable value for T. However, to facilitate comparison 
with the impulse invariance method, we choose here the same value for T as that in 
Example 12.4: T = —*-. The substitution of w-T = 7/10 in the above equation yields 


10w, * 
+1 
H{z] = 0.135 ai) 
k 1357 (aaa 


Hence 


0.1357(e7"T + 1) 


H jwT Peaches r 
[en | = ar 0.7984 
0.1357 T+14+ isin wT 
= (cos wT + +jsinw ) T =n x10 
cos wT — 0.7284 + j sin wT 
From this we obtain 
1/2 
o 0.024(1 + cos wT) 
H jw? A sinih ea A = 6 
|H[e*"]| feared T=nx 10 (12.59a) 


and 


z-1 
Tz 


$= ža- =)= (12.56a) 


Similarly, starting with the power series for e*T yields the transformation 
1 
$= ple 1) (12.56b) 


These are strikingly simple transformations, which work reasonably well for lowpass and bandpass 
filters with low resonant frequencies. They cannot be used for highpass and bandstop filters, 
however, and they are inferior to bilinear transformation. The transformation in Eq. (12.56b) also 
has a stability problem. 
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—n/2 = 
ZH[ej®2T] 


Fig. 12.12 Bilinear transformation method of design: (a) amplitude response (b) phase 
response. 


sin wT -1 sin wT 
1 + cos wT tan os wT — 0.7285 (12.59b) 
Figure 12.12 shows |H| and ZH as computed from Eqs. (12.59). Compare these with the 
filter characteristics obtained from the impulse invariant method (Fig. 12.11). | 


LHe?" | = tan? 


© Computer Example C12.4 

Using MATLAB, find the bilinear transformed digital filter to realize the first-order 
analog Butterworth filter in Example 12.5. 

The analog filter transfer function is 10°/(s + 10°) and the sampling interval T = 
107°. Hence, the sampling frequency Fs= 10°/z. A suitable MATLAB function to solve 
this problem is ‘bilinear’. The input data are the coefficients of the numerator and 
the denominator polynomials of Ha(s) [entered as (n + 1)-element vectors num and den] 
and the sampling frequency Fs Hz. MATLAB returns b and a, the numerator and the 
denominator polynomial coefficients of the desired digital filter H [z]. 


Fs=10°6/pi; num=[0 10°5];den=[1 10^5]; 
[b,a]=bilinear(num,den,Fs) 
MATLAB returns b=0.1358 0.1358 and a=1 -0.7285. Therefore 


__ 0.1358(z +1) 
Hlel = 9 7385 


which agrees with the answer found in Example 12.5. To plot the amplitude and the phase 
response, we can use the last 8 functions in Example C12.. © 
Frequency Prewarping Inherent in Bilinear Transformation 


Figure 12.12 shows that |H [eT] ~ |Ha(jw)| for small w. For large values of w, 
the error increases. Moreover, |H [e7”7]| = 0 at w = x/T. In fact, it appears as if the 
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entire frequency band (0 to oo) in |Ha(jw)| is compressed within the range (0, 4 
in H[e?*T]. Such warping of the frequency scale is peculiar to this transformation. 
To understand this behavior, consider Eq. (12.55a) with s = jw 


; 2 eT] eee as 
HeT = Ha | — ———— ) =H : = Ha (j tan T 
le ] (5 Ser} a T e pe a (iF n 3) 


Therefore, response of the resulting digital filter at some frequency wg is 


H[eiT) = Ha (ja tan #47) 


= Ha(jwa) (12.60) 
where 
2 T 
w= y tan 7 (12.61a) 


Thus, in the resulting digital filter, the behavior of the desired response Ha(jw) at 
some frequency wa appears not at wa but at frequency wa, where [from Eq. (12.61a)] 


-1 WaT 
2 
Figure 12.13a shows the plot of wa as a function of wa. For small wa, the curve 
in Fig. 12.13a is practically linear, so wg ~ wa. At higher values of wa, there is 
considerable diversion in the values of wa and wg. Thus, the digital filter imitates 
the desired analog filter at low frequencies, but at higher frequencies there is consid- 
erable distortion. Using this method, if we are trying to synthesize a filter to realize 
H a(jw) depicted in Fig. 12.13b, the resulting digital filter frequency response will 
be, as illustrated in Fig. 12.13c. The analog filter behavior in the entire range of 
Wa from 0 to co is compressed in the digital filter in the range of wg from 0 to 1/T. 
This is as if a promising 20 year old man, who, after learning that he has only a 
year to live, tries to crowd his last year with every possible adventure, passion, and 
sensation that a normal human being would have experienced in an entire lifetime. 
This compression and frequency warping effect is the peculiarity of the bilinear 
transformation. 
There are two ways of overcoming frequency warping. The first is to reduce 
T (increase the sampling rate) so that the signal bandwidth is kept well below 7 
and wa = wa over the desired frequency band. This step is easy to execute, but 
it requires a higher sampling rate (lower T) than necessary. The second approach, 
known as prewarping, solves the problem without unduly reducing T. 


2 
d= tan (12.61b) 


12.6-1 Bilinear Transformation Method with Prewarping 


In prewarping, we start not with the desired H,(jw) but with a prewarped 
H (jw) in such a way that the warping because of bilinear transformation will 
compensate for the prewarping exactly. The idea here is to begin with a distorted 
analog filter (prewarping) so that the distortion caused by bilinear transformation 
will be canceled by the built-in (prewarping) distortion. The idea is similar to 


12.6 Recursive Filter design: The Bilinear Transformation Method 745 
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Oy 


T 
T 


Fig. 12.13 Frequency warping in bilinear transformation: (a) mapping relationship of 
analog and digital frequencies (b) analog response (c) corresponding digital response. 


the one used in prestressed concrete, in which a concrete beam is precompressed 
initially. When loaded, the beam experiences tension, which is canceled by the 
built-in compression. 

Usually the prewarping is done at certain critical frequencies rather than over 
the entire band. The final filter behavior is exactly equal to the desired behavior 
at these selected frequencies. Such a filter is adequate for most filtering problems 
if we choose the critical frequencies properly. 

If we require a filter to have gains g3, 92, ..., 9m at frequencies (critical frequen- 
cies) w1, w2, ..., Wm respectively, then we must start with an analog filter H (jw) 
which has gains g1, g2, ---, gm at frequencies w1’, wo’, ..., wm’ respectively, where 
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a 2 : wit 

Wi = T an 3 

This results in prewarped filter H’(jw). Application of the bilinear transfor- 

mation (12.57) to this filter yields the desired digital filter which has gains g1, go, 

<., Jm at frequencies w1, w2, . . -, Wm respectively. This is because, according to Eq. 

(12.61a), the behavior of the analog filter at a frequency w;’ appears in the digital 
filter at frequency 


2 ait wit = Ż tan“! tan uT = wi 
T 2) T et 


We clarify these ideas with an example of a lowpass Butterworth filter. 


i=1,2,---,m (12.62) 


| Example 12.6 

Design a lowpass filter with the following specifications: The gain of unity at w = 0, 
and the gain is to be no less than —2 dB (Gp = 0.785) over the passband 0 < w < 10. 
The gain is to be no greater than ~11 dB (Gs = 0.2818) over the stopband w > 15. The 
highest frequency to be processed is wa = 35 rad/s, which yields T < 1/35. Let us use 
T = 7/35. 

The specifications for a Butterworth filter for this design are wp = 8, ws = 15, Gp = 
—2 dB, and G, = —11 dB. In the first step, we prewarp the critical frequencies wp and ws 
according to Eq. (12.62): 


wy’ = Ztan “2? = I tan (42) = 8.3623 


2 
ws’ = 2 tan “3? = 2 tan (484) = 17.7696 
In the second step, we design a Butterworth filter with critical frequencies wp’ = 8.3623 
and ws’ = 17.7696 with Gp = —2 dB and G, = —11 dB. The value of n (order of the filter) 
is obtained from Eq. (7.39): 


log((10?* ~ 1)/(10°? — 1)] 
~  2log(17.7696/8.3623) 


= 1.9405 


We round up the value of n to 2. There are two possible values of w'e. We shall choose 
the one given by equation (7.41), which satisfies the stopband specifications exactly, but 
oversatisfies that in the passband. This choice yields the 3-dB cutoff frequency wc’ as 


1 17.7696 
w 


(= — |, = 9.6308 
(101-1 — 1)4 


From Table 7.1, we find the prewarped filter transfer function Ha(s) for n = 2 and wc' = 


9.6308 as 1 92.7529 
Ha(s) = = ~ 


(sus) +v2 (s30) el osa Gee 92.7529 


Finally, we obtain H[z] from Ha(s), using the bilinear transformation 


TET e 
—\T/z+1 \a/ zt+l 


This substitution yields 


jH[ef@T}] 
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0.794 f= 


0.282 


Fig. 12.14 Amplitude response of the filter in Example 12.6. 


Hz] = Ha(s)|,-(20) ee 


Biota AEE 
= 3? F 13.628 + 92.7529 |.2( 22) 253 


_  0.1039(2 + 1)? 
~ 22 — 0.90452 + 0.3201 


The frequency response of this filter is given by 


0.1039(e7"7 + 1)? 
ei2wT — 0.9045e4T + 0.3201 


H [7] = 
The amplitude response |H{e%*7]|, with T = 70/7, is depicted in Fig. 12.14. a 
Summary of the Bilinear Transformation Method with Prewarping 


In the bilinear transformation method with prewarping, all the critical frequen- 
cies w; are transformed (prewarped) by the equation 


2 T , 
of = 2 tan “T i=l, ee (12.63a) 


The prewarped cutoff frequency w,’, determined by using prewarped critical fre- 
quencies, is used to find the prewarped analog filter transfer function Hq(s). Fi- 


nally, we replace s with 2z in Ha(s) to obtain the desired digital filter transfer 


function H [z] 


(12.63b) 


et 


zo 


E 
e STI 


H [z] = Ha(s)| 
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A Simplified Procedure 


The above procedure can be simplified by observing that the scaling factor 2 
is irrelevant in this manipulation and can be ignored. Instead of using Eqs. (12.63a) 
and (12.63b), we can use the simplified equations 


wi = tan we i= l, 2, s>. m (12.64a) 


and ra 
= 12.64b 
ae +1 ( ) 
This simplification works because the factor 2/T in Eq. (12.63a) is a frequency 
scaling factor, and ignoring it in Eq. (12.64a) results in the pretransformed filter 
that is scaled by a factor 2/T in the frequency scale. This scaling is undone by 

using Eq. (12.64b) instead of Eq. (12.63b). 

To demonstrate the procedure, we shall redo Example 12.6 using this simplifi- 
cation. In the first step, we prewarp the critical frequencies wp and ws according to 


Eq. (12.64a): 


wy! = tan BT = tan (42) = 0.3753 


we! = tan “8? = tan (32) = 0.7975 
In the second step, we design a Butterworth filter with critical frequencies 


wp = 0.3753 and wg! = 0.7975 with Gp = —2 dB and G, = —11 dB. The value of 
n (order of the filter) is found from Eq. (7.39): 


log[(10!-1 — 1)/(10°? — 1)] 


= 1.9405 
210g (0.7975/0.3753) 


n= 


We round up the value of n to 2. Also from Eq. (7.41), we find the 3-dB cutoff 


frequency we’ as 
° A 0.7975 


EUSPEN 


From Table 7.1, we find the prewarped filter transfer function H a(s) for n = 2 and 
we’ = 0.4322 as 


= 0.4322 


We 


1 a 0.1868 
(a) + v2 (aiz) +1 a aee: 0:3303 


Hals) = 


Finally, we obtain H [z] from H,(s), using the simplified bilinear transformation in 
Eq. (12.64b): 


Therefore 


0.1868 0.1039(z + 1)? 
H{z] = Hals)ls=z5} = 524 06112s +0.1868|,_ 2-1 2? + 0.9042 + 0.3201 


z+ł 


l 
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which is identical to the result obtained earlier. 


© Computer Example C12.5 

Design a lowpass digital filter to meet the specifications in Example 12.6, using bilin- 
ear transformation with prewarping. 

We shall give here MATLAB functions to design the four types of approximations: 
Butterworth, Chebyshev, inverse Chebyshev, and elliptic. The input data asks for fre- 
quencies so normalized that the sampling radian frequency is 2. This requirement means 
the sampling radian frequency, which is 27/7’, must be normalized to 2. Therefore, all the 
radian frequencies can be normalized by multiplying each of them by T/r. In the present 
case, T = 7/35 so that T/m = 1/35. Thus, to normalize any radian frequency, we just 
divide it by 35. The normalized Wp and Ws are 8/35 and 15/35, respectively. 


Wp=8/35;Ws=15/35;Gp=-2;Gs=-11;T=pi/35; 


% Butterworth 
[n,Wn]=buttord(Wp, Ws,-Gp,-Gs); 
[b,a]=butter(n,Wn) 


% Chebyshev 
{[n,Wn]=cheblord(Wp, Ws,-Gp,-Gs); 
[b,a]=cheby1(n,-Gp,Wn) 


% Inverse Chebyshev 
[n, Wn]=cheb2ord(Wp,Ws,-Gp,-Gs); 
[b,a]=cheby2(n,-Gs, Wn) 


% Elliptic 
{n, Wn]=ellipord(Wp, Ws,-Gp,-Gs); 
[b,a]=ellip(n,-Gp,-Gs,Wn) 


% Plotting Amplitude and Phase Response 
W=0:.001:pi;W=W’; 

H=freqz(b,a,W); 

w=W/T; 

mag=abs(H); 
phase=180/pi*unwrap(angle(H)); 
subplot(2,1,1); 

plot(w,mag);grid; 

subplot(2,1,2); 

plot(w,phase);grid 


MATLAB returns b=0.1039 0.2078 0.1039 and a=1 -0.9045 0.3201 for Butterworth 
option. Therefore 
Hel = 0.1039(z + 1)? 
~ z2 — 0.9045z + 0.3201 


a result, which agrees with the answer found in Example 12.7. © 


A Exercise E12.5 

Design a first-order lowpass Butterworth filter using the prewarping method so that the 
analog and digital gains are identical at w = 0 and at the 3-dB cutoff frequency we. Use T = 7 [Awe. 
Answer: 
0.8284(z +1) _ 0.2929(z + 1) 


2.8284z — 1.1716 z — 0.4142 


H(z] = 


—=" 
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Fig. 12.15 Chebyshev highpass filter design using bilinear transformation with prewarp- 
ing method. 


@ Example 12.7: Highpass Filter Design 
Design a 1-dB ripple Chebyshev highpass filter with the following specifications (de- 
picted by the brick walls in Fig. 12.15a): The stopband gain G, < —6.3 dB (Gs < 0.484) 
over the stopband 0 < w < 10 (ws = 10). The ripple f < 1 dB (Gp > 0.891) over a 
passband w > 15 (wp = 15). The highest frequency to be processed is w» = 80 radians/s. 
In order to select a suitable value of J’, we use Eq. (12.58) to avoid signal aliasing: 
T T T 


T < — = — = 
so, 7 30 => Let us choose T 100 


The critical frequencies are ws = 10 and wp = 15. The prewarped critical frequencies, 
according to Eq. (12.64a), are 


ws’ = tan “87 = tan (Æ) = 0.1584 


wp! = tan “27 = tan (3%) = 0.24 


In the second step, we design a prewarped Chebyshev highpass filter with critical 
frequencies ws’ = 0.1584 and wp’ = 0.24 with 7 = —1 dB and G, = -6.3 dB (Fig. 
12.15b). Following the procedure in Sec. 7.6-1, we first design a prototype lowpass filter 
with specifications, as indicated in Fig. 12.15b. Observe that the critical frequencies of 
ue peeuee filter are 1 (passband) and wp'/ws' = 1.515 (stopband) as explained in Sec. 


The value of n needed to satisfy these specifications is given by [see Eq. (7.49b)] 


1 _1 [ (10°88 — 1 1/2 
n= ——————~ cosh! | =i: 
cosh7! (238) | —1 1:98 


We round up the value of n to 2. From Table 7.4 (Chebyshev filter with # = 1 and n = 2) 
we obtain the following prototype transfer function 


$ 
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0.982614 


— —__ 0.982614 12.65 
Hels) = 377 0978s + 1.1025 (12.65) 


Next, to obtain the desired highpass transfer function, we replace s with wp'/s in the 
above prototype transfer function [see Eq. (7.55)]. To obtain the desired digital transfer 
function H[z], we then replace s with 2;} [the bilinear transformation in Eq. (12.64b)}. 
This two-step operation may be combined in a single-step transformation as 


Wp. = wp (z +1) 
(ga) ERN 


(12.66) 


In this case wp’ = 0.24 so that we replace s with O24) in the prototype transfer function 
in Eq. (12.65) to obtain the desired digital transfer function 


0.6902(z — 1)? 


Hl] = 37 ae7@7 4 0.6298 


The continuous curve in Fig. 12.15a shows the amplitude response of this filter. | 


© Computer Example C12.6 

Design a highpass digital filter to meet the specifications in Example 12.7, using 
bilinear transformation with prewarping. 

As before, we shall give here MATLAB functions to design the four basic types of 
approximations. The input data asks for frequencies so normalized that the sampling 
radian frequency is 2. As explained in Example C12.5, all the radian frequencies can be 
normalized by multiplying each of them by T/r. In the present case, T = 7/100 so that 
T/x = 1/100. Thus, to normalize any radian frequency, we just divide it by 100. The 
normalized Wp and Ws are 15/100 and 10/100, respectively. 


Wp=0.15;Ws=0.1;-Gp=1;-Gs=6.3;T=pi/100; 


% Butterworth 
{n,Wn]=Buttord(Wp, Ws,-Gp,-Gs); 
[b,a]=butter(n,Wn,’high’); 


% Chebyshev 
[n, Wn]=cheblord(Wp, Ws,-Gp,-Gs); 
[b,a]=cheby1(n,-Gp,Wn,’high’); 


% Inverse Chebyshev 
[n,Wn]=cheb2ord(Wp, Ws,-Gp,-Gs); 
[b,a]=cheby2(n,-Gs,Wn,’high’) 


% Elliptic 
[n, Wn]=ellipord(Wp,Ws,-Gp,-Gs); 
[b,a]=ellip(n,-Gp,-Gs, Wn,’high’) 


MATLAB returns b=0.6902 -1.3804 0.6902 and a=1 -1.4678 0.6298 for Chebyshev op- 
tion. Therefore 

0.6902(z — 1)? 
~ z2 — 1.4678z + 0.6298 


H{z] 


which agrees with the answer found in Example 12.6. To plot the amplitude and the phase 
response, we can use the last 9 functions in Example C12.5. © 
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Bandpass and Bandstop Filters 


For bandpass and bandstop filters, we follow a similar procedure. All the critical 
frequencies are first prewarped using the simplified form in Eq. (12.64a). Next, we 
determine a prototype lowpass filter, which is then converted to the desired analog 
filter using appropriate transformations discussed in Sec. 7.6. Finally, we use the 
bilinear transformation in Eq. (12.64b) to obtain the desired digital filter. As in 
the case of the highpass filter (discussed in Example 12.7), we can combine the two 
transformations into a single transformation. For the bandpass filter, we first use 
the transformation 


2 , t 
s| + Wp, Wp, 


To= (wp — Wp,')s 


and then use the bilinear transformation in Eq. (12.64b). Thus, in the first step 
we replace s in the prototype transfer function Hp(s) with T(s) (the frequency 
transformation). In the second step we replace s with zt (the simplified bilinear 
transformation). Thus, the final transformation is equivalent to replacing s with 
Tbp[z] in the prototype filter transfer function H,(s), where 


8? + Wp, Wp 
(Wp: — wp ')s 
2 (z — 1)? + wp, wpa (z + 1)? 

(wpe! ~ Wp,/)(z? — 1) 
2 (wp, wp + 1)z? + 2(wp, wp — 1)z + (wp wp + 1) 
(wp,’ ui wp (z? - 1) 


Toplz] = T(s)|,=253 = 


last 


Using the same argument, we can show that for the bandstop filter, the desired 
digital filter transfer function H [z] can be obtained from the corresponding bandstop 
prototype filter H,(s) by replacing s with T,,[z], which is the reciprocal of Tpp[z]. 
Both these transformations can be expressed in a more compact form as 


z? +2az +1 
Toplz] = G? zD (12.67a) 
b(z? — 1) 
Ts [2] = > —>——- 2.67b 
bs [2] ee (12.67b) 
where 
j 1 ' EE 1 
aa tnt l ne p= 2n eed (12.68) 


Wp Wp,’ +1 Wp Wp + 1 

Thus, a digital filter transfer function H [z] can be obtained from H,(s) by 
replacing s with Tpp|z] for the bandpass filter, and replacing s with Tbs [z] for the 
bandstop filter. 
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@ Example 12.8 

Design a digital Butterworth bandpass filter with amplitude response specifications 
illustrated by the brick walls in Fig. 12.16a with wp, = 1000, wp, = 2000, ws, = 450, 
ws, = 4000, Gp = 0.7852 (—2.1dB), and Gs = 0.1(—20dB). Take T = 7/10, 000. 

The solution is executed in 3 steps: In the first step, we determine the prewarped 
critical frequencies. In the second step, the lowpass prototype filter transfer function Hp(s) 
is found from the prewarped critical frequencies. Finally, the desired H [z] is found from 
Hp(s) using the lowpass analog to bandpass digital transformation by replacing s in Hp(s) 
with Typ[z]- 

Step 1: Find prewarped critical frequencies 

The prewarped frequencies wp,’, wp,’, Ws,» and ws,’ corresponding to the four critical 

frequencies wp,, Wp2, Ws,, and Ws, using Eq. (12.64a): 


Step 2: Find Hp(s), the prewarped lowpass prototype analog filter 
This procedure with 5 substeps is identical to step 1 in the design of an analog 
bandpass filter discussed in Example 7.10 (Sec. 7.6-2). The 5 substeps are: 


Step 2.1: Find w,’ for the prototype filter. For the prototype lowpass filter 
transfer function Hp(s) with amplitude response, as depicted in Fig. 12.16b. The 
frequency ws’ is found {using Eq. (7.56)} to be the smaller of 


(0.1584)(0.3249) — (0.0708)? 
0.0708(0.3249 — 0.1584) 


(0.7265)? — (0.1584) (0.3249) 


= 3.937 
0.7265(0.3249 — 0.1584) 


= 3.939 and 


which is 3.937. We now have a prototype lowpass filter in Fig. 12.16b with G = —2.1 
dB, G, = —20 dB, wp’ = 1, and we’ = 3.937. 


Step 2.2: Determine the filter order n 
The order of the Butterworth filter from Eq. (7.39) is 


1 ii 10? -1 
= 2log 3.937 “© | 10037 -1 


n | = 1.8498 
which is rounded up to n = 2. 


Step 2.3: Determine the cutoff frequency we of the prototype filter 
In this step (which is not necessary for the Chebyshev design), we determine the 3-dB 
cutoff frequency wc’ for the prototype filter using any one of the Eqs. (7.40) or (7.41). 
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Fig. 12.16 Butterworth bandpass filter design using the bilinear transformation with 
prewarping. 


Each equation gives a different answer, in general. However either answer will satisfy 
the specifications. Let us select Eq. (7.41), which yields 


’ 
, Ws 


We 


Step 2.4: Find the normalized filter transfer function 
The normalized second-order Butterworth filter transfer function (from Table 7.1) is 


1 


ue s?4+V2s+1 

Step 2.5: Find the prototype filter transfer function H,(s) 

The prototype filter transfer function Hp(s) is obtained by substituting s with s/w.’ = 
s/1.248 in the normalized transfer function H(s) found in step 4. This substitution 
yields 

(1.248)? 1.5575 


s2 + V2(1.248)s + (1.248)? 8? + 1.76495 + 1.5575 


Hp(s) = 


Step 3: Find H[z] by using the bilinear transformation 
Finally, the desired transfer function H [z] of the bandpass filter is obtained from 
Hp(s) by replacing s with Top[z] from Eqs. (12.67) and (12.68). From Eq. (12.68), we 
obtain 


_ wyy'wp'—1 _ —0.9485 


23 Z wpa — Wp, _ 0.1665 
Wp, Wp’ +1 1.0515 


= —0.9021 and b= 
02l Be Pe eat. T0515 


= 0.1583 


5 
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Substitution of these values in Eq. (12.67) yields 


z? +2az+1 _ 6.317(27 — 1.8042z + 1) 
b(z2-1) z?-1 


Top [z] = 


The desired bandpass filter transfer function H [z] is obtained from Hp(s) by substituting 
s with Thp[z] : 


0.02964(2? — 1)? 


Hz] = 
le] = 212511923 + 3.92622 — 2.3842 + 0.576 


The amplitude response |H [eT] of this filter is illustrated in Fig. 12.16a. E 


© Computer Example C12.7 

Design a bandpass digital filter to meet the specifications in Example 12.8, using 
bilinear transformation with prewarping. 

As before, we shall give here MATLAB functions to design the four basic types of 
approximations. In this case, Wp and Ws are 2-element vectors: Wp=[1000 2000] and 
Ws=[450 4000]. The input data asks for frequencies so normalized that the sampling 
radian frequency is 2. As explained in Example C12.5, all the radian frequencies can be 
normalized by multiplying each of them by T/r. In the present case, T = 1/10* so that 
T/r =1/ 10*. Thus, to normalize any radian frequency, we just divide it by 104. The 
normalized Wp and Ws are [0.1 0.2] and [0.045 0.4], respectively. 


Wp=[0.1 0.2};Ws=[0.045 0.4];Gp=-2.1;Gs=-20; 


% Butterworth 
[n,Wn]=buttord(Wp, Ws,-Gp,-Gs); 
(b,a]=butter(n,Wn) 


% Chebyshev 
[n,Wn]=cheblord (Wp,Ws,-Gp,-Gs) 
[b,a]=cheby1(n,-Gp,Wn) 


% Inverse Chebyshev 
{n, Wn]=cheb2ord(Wp,Ws,-Gp,-Gs) 
[b,a]=cheby2(n,-Gs,Wn) 


4% Elliptic 
{n, Wn}=ellipord(Wp,Ws,-Gp,-Gs) 
[b,a]=ellip(n,-Gp,-Gs,Wn) 


MATLAB gives b=0.0296 0 -0.0593 0 0.0296 and a=1 -3.119 3.9259 -2.3539 0.576 
for Butterworth option. Therefore 


0.0296(z? — 1)? 


H[z] = 
[z] z4 — 3.119z3 + 3.925922 — 2.3539z + 0.5760 


a result, which agrees with the answer found in Example 12.8. To plot the amplitude and 
the phase response, we can use the last 9 functions in Example C12.5. © 


© Computer Example C12.8 

Using bilinear transformation with prewarping, design a bandstop digital filter to 
meet the following specifications: Wp=[450 4000], Ws=[1000 2000], Gp = —2.1 dB, and 
G, = —20 dB. Use T = 7/104. 


Ne <u 
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As before, we give here MATLAB functions to design the four types of approxima- 
tions. The input data asks for frequencies so normalized that the sampling radian fre- 
quency is 2. As explained in Example C12.5, all the radian frequencies can be normalized 
by multiplying each of them by T/r. In the present case, T = x/10* so that T/r = 1/104. 
Thus, to normalize any radian frequency, we just divide it by 104. 


Ws=[0.1 0.2];Wp=[0.045 0.4];Gp=-2.1;Gs=-20; 


% Butterworth 
[n,Wn]=buttord(Wp,Ws,-Gp,-Gs) 
[b,a]=butter(n,Wn,’stop’) 

% Chebyshev 

[n,Wn]=cheblord(Wp, Ws,-Gp,-Gs) 
[b,a]=cheby1(n,-Gp,Wn,’stop’) 


% Inverse Chebyshev 

(n,Wn]=cheb2ord(Wp, Ws,-Gp,-Gs); 

{b,a]=cheby2(n,-Gs, Wn,’stop’) 

% Elliptic 

[n,Wn]=ellipord(Wp,Ws,-Gp,-Gs); 

{b,a]=ellip(n,-Gp,-Gs,Wn,’stop’) 
MATLAB returns b=0.3762 -1.3575 1.9711 -1.3575 0.3762 and a=1 -2.2523 2.0563 
-1.2053 0.4197 for Chebyshev option. Therefore 


pje] = 23702 — 8.60842" + 5.23952” — 9.60842 + 1) 
z4 — 2.252323 + 2.05632? — 1.2053z + 0.4197 


To plot the amplitude and the phase response, we can use the last 9 functions in Example 
012.5. © 


12.7 Nonrecursive Filters 


The recursive filters are very sensitive to coefficient accuracy. Inaccuracies in 
their implementation, especially too short a word length, may change their behavior 
drastically and even make them unstable. Moreover, the recursive filter designs are 
well established only for amplitude responses that are piecewise constant, such as 
lowpass, bandpass, highpass, and bandstop filters. In contrast, a nonrecursive filter 
can be designed to have an arbitrarily shaped frequency response. In addition, 
nonrecursive filters can be designed to have a linear phase response. On the other 
hand, if a recursive filter can be found to do the job of a nonrecursive filter, the 
recursive filter is of lower order; that is, it is faster (with less processing delay) and 
requires less memory. If processing delay is not critical, the nonrecursive filter is the 
obvious choice. They also have an important place in non-audio applications, where 
a linear phase response is important. We shall review the concept of nonrecursive 
systems briefly. 

As discussed in Sec. 12.3, nonrecursive filters may be viewed as recursive filters, 
where all the feedback or recursive coefficients are zero; that is , when 


ag =a, = 02 => = an- =O 


Consequently, the transfer function of the resulting nth-order nonrecursive filter is 
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_ bnz” + bn—12”7! +- + biz + bo 


H{z] a (12.69a) 
bn-1 , bn-2 bı bo 
=bn + a ee Se (12.69b) 
Now, by definition, H [z] is the z-transform of hfk]: 
oo 
Hz] = X hfk] 
k=0 
Afi h{2 h h 1 
= no) + $E + Ft nh n+ Pe (12.70) 


z’ gntl 


Comparison of this equation with Eq. (12.69b) shows that h[k] = 0 for k > n, and 
Eq. (12.70) becomes 


ate] = nfo} + MA, AEN... Be (12.71a) 
_ Alle” + Alem"? +--+ + Alm ~ Mz + Al] (12.71b) 
where 
T e SeA (12.72) 
7 0 k>n 


The impulse response h|k] has a finite width of (n + 1) elements. Hence, these 
filters are finite impulse response (FIR) filters. We shall use the terms nonrecursive 
and FIR interchangeably. Similarly, the terms recursive and IIR (infinite impulse 
response) will be used interchangeably in our future discussion. 

The impulse response h[k] can be expressed as 


h[k] = h{O]6[&] + h[1]6[k — 1] + --- + A[n]5[& — n] (12.73) 


The frequency response of this filter is obtained from Eq. (12.71a) as 


He] = hO) + Alte? +--+ + hine T (12.74a) 
= > Alle 7*#F (12.74b) 
k=0 


Filter Realization 


The nonrecursive (FIR) filter in Eq. (12.69a) is a special case of a general 
filter with all feedback (or recursive) coefficients zero. Therefore, the realization of 
this filter is the same as that of the nth-order recursive filter with all the feedback 
connections omitted. Figure 12.7b shows a canonical realization of this filter. It is 
easy to verify from this figure that for the input 6[k], the output is h[k] given in Eq. 
(12.73). 
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The filter in Fig. 12.7b is a tapped delay line with successive taps at unit dela 

(T seconds). Such a filter is known as a transversal filter. Tapped analog dela: 4 
are integrated circuits, which are available commercially. In these circuits the ced 
delay is implemented by using charge transfer devices, which sample the input signal 
every T seconds (unit delay) and transfer the successive values of the samples to m 
storage cells. The stored signal at the kth tap is the input signal delayed by k time 
units (kT seconds). The sampling interval can be varied electronically over a wide 
range. Time delay can also be obtained by using shift registers. 


12.7-1 Symmetry Conditions for Linear Phase Response 


Consider an nth-order finite impulse response (FIR) filter described by the 
transfer function H[z] | Eq. (12.69) or (12.71)] and the corresponding impulse re- 
sponse h[k] [Eq. (12.73)]. We now show that if h[k] is either symmetric (Fig. 12.17a) 
or antisymmetric (Fig. 12.17b) about its center point, the filter phase response is 
a linear function of w. We consider a case where n is even. To avoid too much 
abstractness, we choose some convenient value for n, say n = 4, to demonstrate our 
point. It will then be easier to understand the generalization to the nth-order case. 

For n = 4, the impulse response in Eq. (12.73) reduces to 


Alk] = hlO}[k] + AlI]olk — 1] + A[2]o[k — 2] + A[B]s[& — 3] + h[A]6l[& — 4] 


The transfer function H[z] in Eq. (12.71b) reduces to 


H{[z] = Ao] + au + a + a + HA (12.75a) 
=z? (no + hfa] + Al2] + Afs]z7* + hiale~?) (12.75b) 


Therefore, the frequency response is 


Hiei?) = e F2wT (mer 4 A[t]eeT + AQ] + h[3]e—¥"T + hlsje-™" ) (12.76) 


If h[k] is symmetric about its center point (k = 2 in this case), then 
ho] = Al4],  A[1] = hi3] 


and the frequency response reduces to 
le] =e" (nfo [eT eT 4 hla +f [eT 4 en) 


=e JeT (re + 2h[1] cos wT + 2h{0] cos 2T) (12.77) 


hik] 
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Fig. 12.17 Symmetry conditions for linear phase frequency response in nonrecursive 
filters. 


The quantity inside the parenthesis is real; it may be positive over some bands of 
frequencies and negative over other bands. This quantity represents the amplitude 
response |H [e#”7]|.{ The phase response is given by 


LH [e#?) = -2wT 


The phase response is a linear function of w. The time delay is the negative of 
the slope of ZH [e#”7] with respect to w, which is 2T seconds in this case {see Eq. 


(4.59)]. 
If h[k] is antisymmetric about its center point, then the antisymmetry about 


the center point requires that h[k] = 0 at the center point [see Fig. 12.17b]. Thus, 
in this case 


no} = —h[4], AL] = Als], —Af2] = 0 


and the frequency response reduces to 
Ale”? = giwt (aoe — eT) 4 h{i}(e%?? - gih) 
= 2je TT (au sin wT + h[0] sin 2T) 
= Qei(F-%T) (mal sin wT + h[0] sin 20 
Thus, the phase response in this case is 


LH ei] = 5 -wT 


{Strictly speaking, |H{e?*7]| cannot be negative. Recall, however, that the only restriction on 
amplitude is that it cannot be complex. It has to be real; it can be positive or negative. We 
should have used some other notation such as A(w) to denote the amplitude response. But this 
would create too many related functions causing possible confusion. Another alternative is to 
incorporate the negative sign of the amplitude in the phase response, which will be increased (or 
decreased) by a over the band where the amplitude response is negative. This alternative will still 
maintain the phase linearity. 
tAntisymmetry property requires that h 
possible only if h[k] = 0 at this point. 


[k] = —h[—k] at the center point also. This condition is 
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In {ej 2] 


(a) 


Fig. 12.18 Comb filter: Its impulse and frequency response. 


The phase response in this case is also a linear function of w. The system has the 
time delay (the negative slope of ZH |e“7] with respect to w) of 2T seconds (2 
units), the same as in the symmetric case. The only difference is that the phase 
response has a constant term 7/2. 

We can obtain similar results for odd values of n (see Prob. 12.7-1). This result 
can be generalized for an nth-order case to show that the phase response is linear, 
and the time delay is ap seconds (or % units). 


@ Example 12.9: Comb Filter 
Determine the transfer function and the frequency response of a sixth-order comb 


filter whose impulse response is given by 


h{k] = 6[k] — ôfk — 6] 


This impulse response is illustrated in Fig. 12.18a. Its canonical realization is depicted in 
Fig. 12.18b. Observe that h[k] is antisymmetric about k = 3. Also 


6 4 
i (12.78) 


He] = $ flee * = 1-27 = * 


The frequency response is given by 
He] =1-e 7 
= eUe A 330) 
= Qe 7% sin 3Q 
= 2ei( F-39) sin 32 
The term sin 3 can be positive as well as negative. Therefore 
|H[e?*]| = 2| sin 32| 


and ZH{e'"] is as indicated in Fig. 12.8d. The amplitude response, illustrated in Fig. 
12. 18c, is shaped like a comb with periodic nulls. The filter can be realized by the structure 
in Fig. 12.7b. Since h[k] = be—x [see Eq. (12.72)], bo = —1, bı = b2 = b3 = ba = bs = 0, 
and bs = 1. 


a 


3 
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Using the same argument, the reader can show that an nth-order comb filter transfer 
function is 
(12.79) 


and 
Hie! = 26 F-P) sin me E 


12.8 Nonrecursive Filter Design 


As in the case of recursive (IIR) filters, nonrecursive filters can be designed by 
using the time-domain and the frequency-domain equivalence criteria. In the time- 
domain equivalence criterion, the digital filter impulse response is made identical to 
the samples of the desired (analog) filter impulse response. In the frequency-domain 
equivalence criterion, the digital filter frequency response samples at uniform fre- 
quency intervals are matched to the desired analog filter frequency response samples. 
This method is also known as the frequency sampling or the spectral sampling 
method. 


12.8-1 Time-Domain Equivalence Method of FIR Filter Design 


The timedomain equivalence method (also known as the Fourier series 
method) of design of FIR filters is identical to that for IIR filters discussed in Sec. 
12.5, except that FIR filter impulse response must be of finite duration. Therefore, 
the desired impulse response must be truncated to have finite duration. Truncating 
the impulse response abruptly will result in oscillatory frequency response because 
of the Gibbs phenomenon discussed in Sec. 3.4-3. In some filtering applications 
the oscillatory frequency response (which decays slowly as 1 /w) in the stopband 
may not be acceptable. By using a tapered window function for truncation of hfk], 
the oscillatory behavior can be reduced or even eliminated at the cost of increasing 
the transition band as discussed in Sec. 4.9. Note that the impulse response of 
an nth-order FIR filter has n + 1 samples. Hence, for truncating h{k] for an n-th 
order filter, we must use an N-point window, where Np = n + 1. Several window 
functions and their tradeoffs appear in Table 12.2. 


Design Procedure 


Much of the discussion so far has been rather general. We shall now give some 
concrete examples of such filter design. Because we want the reader to be focussed 
on the procedure, we shall intentionally choose a small value for n (the filter order) 
to avoid getting distracted by a jungle of data. The procedure, however, is general 
and it can be applied to any value of n. 

The steps in the time-domain equivalence design method are: 


1. Determine the filter impulse response A[k] 
In the first step, we find the impulse response A[k] of the desired filter. Ac- 
cording to the time-domain equivalence criterion in Eq. (12.31), 


hfk] = Tha(kT) (12.80) 


a _ eT 
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TABLE 12.2 


Some Window Function and Their Characteristics 


AAG OE AEG RO FS aT EY IEE EI A NIT TEL CESS DIAS, 


Rolloff Peak 
; Mainlobe Rate Sidelobe 
Window wk] Width dB/octave Level in dB 
—M<k<M M=% 

1 Rectangular: rect woo) —6 —13.3 

2 Bartlett: A (x47) x -12 -26.5 

3 Hanning: 0.5 [i + cos ( rea | —18 —31.5 

4 Hamming: 0.54 + 0.46 cos ( RE) A -6 42.7 

5 Blackman: 0.42 + 0.5 cos (%27) +0.08 (44>) pr -18 —58.1 

Io] ay/1-4( yor)” 

6 Kaiser: AC 1<a<10 L= = -6  —59.9 (a = 8.168) 
where h(t) is the impulse response of the analog filter Ha(s). Therefore, ha(¢) 
is the inverse Laplace transform of Ha(s) or the inverse Fourier transform of 
Ha(jw). Thus, 

1 n/T g 
halt) = xf Ha(jw)e?”* dw (12.81a) 
2r —x/T 
Recall that a digital filter frequency response is periodic with the first period in 
the frequency range —% <w < %. Hence, the best we could hope is to realize 
the equivalence of H,(jw) within this range. For this reason, the limits of 
integration are taken from —1/T to 1/T. Therefore, according to Eq. (12.80) 
T a{/T ; 
h[k] = Tha(kT) = — Ha(jw)et?*? dw (12.81b) 
2r —x/T 
2. Windowing 


For linear phase filters, we generally start with zero phase filters for which 
#H (jw) is either real or imaginary. The impulse response h(t) is either an even 
or odd function of t (see Prob. 4.1-1). In either case, ha(t) is centered at t = 0 
and has infinite duration in general. But h[k] must have only a finite duration 
and it must start at k = 0 (causal) for filter realizability. Consequently, the 
A[k] found in step 1 needs to be truncated using an No-point window and then 
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delayed by fest to make it causal. This delay produces the desired linear-phase 
frequency response. 

Straight truncation of data amounts to using a rectangular window, which has 
a unit weight over the window width, and zero weight for all other k. We saw 
that although such a window gives the smallest transition band, it results in a 
slowly decaying oscillatory frequency response in the stopband. This behavior 
can be corrected by using a tapered window of a suitable width. 

* 


3. Filter Frequency Response and Realization 
Knowing h[0], h{1], h[2], ---, h[n], we determine H [z] using Eq. (12.71) and the 
frequency response H|e%“7] using Eq. (12.74). We now realize the truncated 
h{k] using the structure in Fig. 12.7b. 


Optimality of the Procedure 


The procedure outlined here using a rectangular window function is the op- 
timum in the sense that the energy of the error (difference) between the desired 
frequency response Hq(jw) and the realized frequency response H [eT] is the min- 
imum for a given No. This conclusion follows from the fact that the resulting filter 
frequency response H [eT] is given by 


H [eT] = So hike FF? 
k 


This frequency response is an approximation of the desired frequency response 
H,(jw) because of the truncation of h[k]. Thus, 


Ha(jw) = Y hfk]e IF? 
k 


How do we select h[k] for the best approximation in the sense of minimizing the 
energy of the error Ha(jw) — H[e%*7]? We have already solved this problem in 
Sec. 3.3-2. The above equation shows that the right-hand side is the finite term 
exponential Fourier series for Ha(jw) with period 27/T. As seen from Eq. (12.81b), 
h[k] are the Fourier coefficients. We also know that a finite Fourier series is the 
optimum (in the sense of minimizing the error energy) for a given No according to 
the finality property of the Fourier coefficients discussed in Sec. 3.3-2.f Clearly, this 
choice of h{k] is optimum in the sense of the minimum mean squared error. For the 
obvious reason, this method is also known as the Fourier series method. 


@ Example 12.10 
Design an ideal lowpass filter for audio band with cutoff frequency 20 kHz. Use 
a sixth-order nonrecursive filter using rectangular and Hamming windows. The highest 
frequency to be processed is Fa = 40 kHz. 
In this case n = 6 and No =n +1 = 7. First we shall choose a suitable value for T. 
According to Eq. (12.58) 


T 1 —6 
< — = — = 12. 
TS IF, 12.5 x 10 


{Note that this finite term Fourier series corresponds to the rectangular window function. For 
windows other than rectangular, the optimality does not hold. 
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Recall that a continuous-time sinusoid of frequency w, during digital processing appears 
as a discrete-time sinusoid of frequency 2. = wT. The cutoff frequency we = 2%(20,000) = 
40,0007 appears as a discrete-time sinusoid of frequency 


-6 T T 

Qe = weT = 40, 0007 (12.5 x 107°) = > and we = 3T 

The desired (zero phase) filter frequency response is depicted in Fig. 12.19a on both w and 

Q scales. Recall that the digital frequency range is from —z to x only. We wish to design 

an ideal lowpass filter of cutoff frequency wc = fp rad/s. The frequency response has a 

period of 27 on Q scale, and 27/T on w scale. Rather than substitute T = 12.5 x 1076, 

it is convenient to leave T as an unknown in our computations and substitute the value 
only in the end. Thus, we shall use the radian cutoff frequency we = 1/2T. 

The impulse response of the desired ideal lowpass (zero phase) filter in Fig. 12.19a is 

(Table 4.1, Pair 18) 


Erg nt 
ha(t) = ap sine (=) (12.82) 
and according to the impulse invariance criterion [Eq. (12.39)] 
1 wkT 1 1k 
hik] = Th = zsine{ =~) = Ż sinc (™ 
{k] a(kT) = sinc ( or ) 5 sinc ( 5 ) (12.83) 


Figure 12.19b shows A[k]. To make this filter realizable, we need to truncate it using a 
suitable No-point window, then delay the truncated h[k] by Most units. In the present 
example, No = 7. Figure 12.19c shows the impulse response truncated by a 7-point 
rectangular window and Fig. 12.19d shows the truncated h[k] delayed by Xa = 3 units. 

Note that the noncausal filter in this case is made realizable at the cost of a delay of 
t = 3T seconds. This constant delay of s is what produces a linear phase characteristic. 
The rectangular windowed, causal filter impulse response hr[k] is the truncated h{k] in 
Fig. 12.19d delayed by 3T. 


halk] = blk — 3] = Zsine [e] 0<k<6 (12.84) 


The values of the coefficient hr[k] are shown in Table 12.3. Also 


6 
H[z} = So alee" 
k=0 
~-1 1-2, 1-3, 1-4_ 1-6 
Se ta TQ? t 3 
=z (Leyli 1 
= (-3 tirta t+- ) (12.85) 


Hence, the frequency response H prfet”T] is 
6 
Hprle?*?] = >D hafkle 2°87 
k=0 


(eT p e754) a (ei? 4 om) 


1 
T 
—;3wT [1 2 
=e T [5 + Z cos wT — = cos 3u7| 
D> 3r 
2 
T 


_ _-j3wT | l w 2 3w 
= > 12.86 
: $ Trs (am) 3r (a s) a) 
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Fig. 12.19 Nonrecursive method of lowpass filter design. 


The term e757 is a linear phase representing the delay of 3T seconds. The mag- 
nitude of the bracketed term, depicted in Fig. 12.19a by a solid curve, exhibits oscilla- 
tory behavior which decays rather slowly over the stopband. Although increasing n (the 
system order) improves the frequency response, its oscillatory nature persists (Gibbs phe- 
nomenon).f In some filtering applications, the oscillatory characteristic (which decays 


slowly as 1/w) in the stopband may not be acceptable. By using a tapered window func- 


tEq. (12.86) is identical to the first three terms in Eq. (3.61) except that the former is a function 
of w and the latter is a function of t. Clearly, H[e%”7] is a truncated Fourier series for the gate 
function. As we increase n, H{e/“7] converges to the gate function in the manner depicted in Fig. 
3.11. Regardless of the value of n, however, H[e3“T] exhibits oscillatory behavior because of the 
Gibbs phenomenon. 
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TABLE 12.3 


Rectangular Window Hamming Window 


k halk] wk] halk] 

0 —1/37 0.08 —0.00848 
1 0 0.31 0 

2 1/7 0.77 0.245 

3 1/2 1 0.5 

4 1/7 0.77 0.245 

5 0 0.31 0 

6 -1/37 0.08 —0.00848 


tion such as a Hamming window, the oscillatory behavior can be eliminated at the cost 
of increasing the transition band (from passband to stopband). The Hamming window 
function is given by 


aie acca (32%) -55 s lal s “St Aish 
otherwise ` 
In our case No = n +1 = 7. Hence, 
W Pa +0.46 cos (35) -3 < |k| <3 
WH = 
0 otherwise 


Table 12.3 also shows the (delayed) Hamming window coefficients wy[k] and the corre- 
sponding impulse response hy{k] = h{k]wx(k]. The frequency response of the Hamming 
window filter is 


Halet] = eT [2 + 0.245 (eT +e 77) — 0.00848 (e7*7 + 277) 
= eT [1 +0.49 cos wT — 0.01696 cos 3wT] 
With the coefficients halk] (or ha{k]) in Table 12.3, the desired filter can be realized by 


using six delay elements, as depicted in Fig. 12.7. 
According to Eqs. (12.86), we have 


|Hrle*”7}| = |} + 2cos wT — 2 cos 3wT| (12.88a) 
and 
? —3wT when 14+ ĉ2cos wT — 2 cos 3wT >0 
LHrlet*?| = { oe ae z (12.88b) 
n — 3wT when 2+ 2 cos wT — $ cos 3wT < 0 
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For the Hamming filter 
|H g[e®T]| = $ + 0.49 cos wT — 0.01696 cos 3wT LHuyle™T]=-3wWT  (12.88c) 


In either filter, the phase response is a linear function of w with slope —3T, indicating 
time delay of 3T. Note that both hrk] and hy[k] are symmetric about k = 3. E 


O Computer Example C12.9 

Using MATLAB, find the frequency response of the lowpass filter in Example 12.10 
for 98th-order filter. Plot the frequency response for rectangular and Hamming window 
filters. 


NO=99; 

m=(N0-1)/2; 

k=0:N0-1; 

hl1=(1/2)*sine((k-m)/2); 

numi=h1; 

deni=[1, zeros(1,N0-1)]; 
W=-pi:pi/100:pi; 
H1=freqz(num1,den1,W); 
mag1=abs(H1); 
phase1=180/pi*unwrap(angle(H1)); 
for i=1:N0 

k=i-1; 

h2(i)=(1/2)*sine((k-m)/2)* (0.54+0.46*cos(pi* (k-m)/m)); 
end 

num2=h2; 

den2=([1, zeros(1,N0-1)]; 
W=-pi:pi/100:pi; 
H2=freqz(num2,den2,W); 
mag2=abs(H2); 
phase2=180/pi*unwrap(angle(H2)); 
subplot(2,1,1); 
plot(W,mag1,W,mag2);grid; 
subplot(2,1,2); 
plot(W,phasel,W,phase2);grid © 


A Exercise E12.6 
If we were to use n = 8 filter in Example 12.12, show that the filter transfer function for the 


bartlett (triangular) window is 


__ —0.0265326 + 0.238724 + 0.52% + 0.238727 + 0.02653 
zê 


Hiz] 


Observe that in this case the filter order is reduced by 2 because the two end-points have a zero 
value for the Bartlett window. Vv 


@ Example 12.11 
Design a differentiator using a tenth-order nonrecursive filter. 
In this case n = 10 and No = 11. The transfer function of an ideal differentiator is 


H,(s) = s. Therefore, 


T 
Haljw) = jw wW< Z 
(jw) =i GES 
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and according to Eq. (12.81b)} 


= (12.89) 


This is a noncausal filter. We truncate it using an 11-point window and then delay it by 
No=1 Mond = = 5 units to make it realizable. The desired impulse response using a rectangular 
window is 


krik] =h[k-5] O0<k<10 


Table 12.4 shows this impulse response under the rectangular window. The frequency 
response is 


10 
Hrfle*“7| = XO halkle 7 
=0 


Substitution of values of halk] from Table 12.4 in this equation yields 


Arf{e™”™] = Ae Her [eT _ e 3#T) o h(i = e`% T) $ HeT ae e FT) 
= HeT — en MOT) 4 1 (_iS0T E goers 
= he FT [2 sin wT — sin 2wT + 2 sin 3wT — 3sin 4wT + 2 zg sin 5wT] 


= te’ HZ —SwT) [2 sin wT — sin 2wT + 2 3 sin 3wT — 3 3 sin 4wT + 2 = sin Sw 


Hence 


|H rle] |= Ed + |2sin wT — sin 2wT + $sin 3wT — $ sin 4wT + 2 sin 5wT| (12.90a) 


and 


GT 3- SwT w>0 
LHr|e ) = (12.90b) 
-3 +5wT w<0 


The terms +5wT represent the time delay of 5T seconds. Note that because Ha (jw) = jw, 


|Ha(jw)| = lw] 
w/2 w>0 
LHa(jw) = (12.91) 
—1/2 w <0 
Note that according to Eq. (12.81a) 
1 x /{2T 
ha(0) = — jwdw =0 
Qn —2/2T 


Therefore, h{0] = 


a 
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Therefore, the phase characteristic of Hp{e?”7] is identical to the desired (ideal) differen- 
tiator with a delay of 5T seconds. Figure 12.20 shows the amplitude response |H| of the 
realized filter and the |Ha] of the ideal (desired) differentiator. The amplitude response 
|Hr{e?“7}], which is oscillatory, can be improved by using a tapered window function to 
truncate ha(t) gradually. The Hamming window function wy {k] [Eq. (12.87)] for n = 10 
is given by 


0.54 + 0.46 cos (7E) iki <5 
wa [k] = 


otherwise 


Table 12.4 shows the (delayed) Hamming coefficients wy [k] and the corresponding filter 
impulse response hy[k] = h[k]wi[k]. Note that halk] and hy[k] are both antisymmetric 
about k = 5. Using the Hamming coefficients from Table 12.4, Hy [e**7), the windowed 
filter frequency response, is given by 


Hyle?™7] = ee [1.8242sin wT ~ 0.682sin 2wT + 0.2652sin 3wT 


0.0839 sin 4wT + 0.032sin 5wT] 


Figure 12.20 shows the amplitude response of the ideal, the rectangular-windowed, 
and the Hamming-windowed filter characteristics. The phase response of both the realized 
filters are identical, but with a delay of 5T seconds. The amplitude response of the 
windowed (Hamming) filter is practically the same over a large band (two thirds of the 
band) as that for the ideal filter, and hence is preferable to the unwindowed (or rectangular- 
windowed) filter. 


TABLE 12.4 
Rectangular Window Hamming Window 
k hr{k] walk] halk] 
— SS SeeeeeeeeeeeeeSSSSSSSSFSSSSMSMFsFee 
0 1/5T 0.08 0.016/T 
1 -1/4T 0.1678 —0.04195/T 
2 1/3T 0.3978 0.1326/T 
3 -1/2T 0.6821 —0.3410/T 
4 1/T 0.9121 0.9121/T 
5 0 1 0 
6 -1/T 0.9121 —0.9121/T 
7 1/27 0.6821 0.3410/T 
8 ~1/3T 0.3978 —0.1326/T 
9 1/4T 0.1678 0.04195/T 
10 ~-1/5T 0.08 -0.016/T 


Ra ES E I SE 
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Fig. 12.20 An ideal differentiator design by a tenth-order nonrecursive filter using 
rectangular and Hamming windows. 


The amplitude response of the Hamming filter is practically ideal up to frequency 
w ~ (2/3)(x/T) = 2n/3T. If we wish to design a digital differentiator for audio application, 
for instance, where the highest frequency is, say 20 kHz, we should select this frequency 
to be less than 27/3T. Thus, 


2m x 20,000 < = => T < 16.67 us 
Thus, a choice of T < 16.67 ps would result in a desired differentiator. This example (also 
Fig. 12.20) shows that a Hamming window shrinks the passband. This is generally true of 
tapered windows. To compensate for this shrinkage, we start with a passband somewhat 
larger (typically 25% larger) than the design passband. In the present case, for instance, 
selecting T = 16.67 us would make the passband wr = 1/T œ% 2r(30, 000), which is 50% 
higher than the design passband of 20,000 Hz. $ 


© Computer Example C12.10 

Using MATLAB, find the frequency response of the 48th-order digital differentiator 
in Example 12.10. Plot the frequency response for rectangular and Hamming window 
differentiators. 


NO=49; 

m=(N0-1)/2; 

k=0:NO0-1; 

T=1; 
h1=cos((k-m)*pi)./((k-m)*T);h1(25)=0; 
num1=hi1; 

den1=[1, zeros(1,N0-1)]; 
W=-pi:pi/100:pi; 
H1=freqz(num1,den1,W); 
magil=abs(H1); 
phase1=180/pi*unwrap(angle(H1)); 
h2=cos((k-m)*pi)./((k-m)*T).*(0.5440.46*cos(pi*(k-m)./m));h2(25)=0; 


—— — 
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num2=h2; 

den2=den1; 
H2=freqz(num2,den2,W); 
mag2=abs(H2); 
phase2=180/pi*unwrap(angle(H2)); 
subplot(2,1,1); 
plot(W,mag1,W,mag2); 
subplot(2,1,2); 
plot(W,phase2,W,phasel); © 


A Exercise E12.7 
Design a sixth-order nonrecursive filter to realize Ha(jw) = A(wT'/7) 


Answer: i diak 
ssinc? ( 72 kl <3 
hfk] = asine? (4) M's 
0 


kl>3 v 


12.8-2 Nonrecursive Filter Design by the Frequency-Domain Criterion: 
The Frequency Sampling Method 


The frequency-domain criterion is [see Eq. (12.36)] 


Ha(s) = H[e*7] 


In this case we shall realize this equality for real frequencies; that is, for s = jw: 


Ha(jw) = H [eT] (12.92) 


For an nth-order filter, there are only Np = n +1 elements in h{k], and we can hope 
to force the two frequency spectra in Eq. (12.92) to be equal only at No points. 
Because the spectral width is z, we choose these frequencies wo = NT rad/s 


apart; that is , 


2r 


= —. 12.93 
NoT (12.93) 


wo 


We require that 


Ha(jrwo) = H [eT] r=0,1,2,,---,No-1 (12.94) 


Note that these are the samples of the periodic extension of Ha(jw) (or H[e%”7)). 
Because we force the frequency response of the filter to be equal to the desired 
frequency response at No equidistant frequencies in the spectrum, this method is 
known as the frequency sampling or the spectral sampling method. 

In order to find the filter transfer function, we first determine the filter impulse 
response h[{k]. Thus, our problem is to determine the filter impulse response from 
the knowledge of the No uniform samples of the periodic extension of the filter 
frequency response H [eT]. But H [eT] is the DIFT of h[k] {see Eq. (10.92)}. 
Hence, as shown in Sec. 10.6-2 [Eqs. (10.68) and (10.69)], A[k} and H{e?"°7] (the 
No uniform samples of H{e?“7]) are the DFT pair with Qo = woT. Hence, the 
desired A{k] is the IDFT of H[e”7], given by 
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1 Next 
alk] = — H eitwot ei tkwoT 
M= y Her) 
No—1 


1 , on 
= YO Hlei#oT e9 For k=0, 1, 2,,---,No—1 (12.95) 
r=0 


Note that H[e3"°T] = Hq(jrwo) are known [Eq. (12.94)]. We can use IFFT to 
compute the No values of h[k]. From these values of A[k], we can determine the 
filter transfer function H[z] as 


No-1 


H{z]= X hfk] 


k=0 


(12.96) 


Linear Phase (Constant Delay) Filters 


We desire that Ha(jw) = H[e%*7]. The filter featured in Eqs. (12.95) and 
(12.96) satisfies this condition only at the No values of w. Between samples, the 
frequency response, especially the phase response, could deviate considerably. If 
we want a linear phase characteristic, the procedure is slightly modified. First, we 
start with a zero phase (or a constant phase +5 ) response. For such a frequency 
response hfk] is an even (or odd) function of k (see Prob. 4.1-1). In either case, 
h [k] is centered at k = 0. To realize this noncausal filter, we need to delay h{k] by 
(No — 1)/2 units. Such a delay amounts to multiplying H[e%”7] with ed eT, 
Thus, the delay of h[k] does not alter the filter amplitude response, but the phase 
response changes by —(No — 1)wT'/2, which is a linear function of w. Hence, we are 
assured that the filter is realizable (causal) and has a linear phase. Thus, if we wish 
to realize a frequency response H [e/”"], we begin with H [eJ”7 ]e~4 “O=*wT and find 
the IDFT of its No samples. The resulting IDFT at k = 0, 1, 2, 3, ---, No—1lis 
the desired impulse response, which is causal, and the corresponding phase response 
is linear. 

2r 


Note that woT = 2%, and the No uniform samples of H [e%”7 Je 


zN -1 
No’ I~z-T are 


H, = H [eT] eir oT 


; 2ar oon NoT 
=H [e? Bor enir A (12.97) 
Recall that the No samples H, are the uniform samples of the periodic extension 
: ;No-1 
of H{e)”T]e-J~“z—“T _ Hence, Eq. (12.97) applies to samples of the frequency range 
from 0 < w < #. The remaining samples are obtained by using the conjugate 
symmetry property H, = Hx,_,. The desired A[k] is the IDFT of H,; that is, 


No-1 
1 aes 
h{k] = a YO Hye? Ro k=0, 1, Ng (12.98) 
r=0 


and 
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Fig. 12.21 Lowpass filter design using the frequency sampling method. 


No-1 


H[z]= $. hjk] 


k=0 


(12.99) 


This procedure will now be explained by an example. 


@ Example 12.12 
Using the frequency sampling method, design a sixth-order nonrecursive ideal lowpass 
filter of cutoff frequency 7p rad/s. 
The frequency response H[e*“7] of an ideal lowpass filter is shown (shaded) in Fig. 
12.21. In this case 
No=t, Ny =F > Nor T 


The seven samples H, in Eq. (12.97) are 


Thus 
Ho =1, Hi =e, Hp = Hs =0 
The remaining three samples should be determined using the conjugate property of DFT, 


H, = Hy,-,, that is Hy = H7_,. Thus 


Ha = Hi =0, Hs = Hi =0, He = Hi = AF 


The desired A[k] is the IDFT of H, given by [Eq. (12.98)] 


6 
hk] = So Het 
r=0 
We may compute this IDFT by using the IFFT algorithm or by straightforward 
substitution of values of H, in the above equation as 


k=0, 1, 2, 3,---, 6 


R 


774 12 Frequency Response and Digital Filters 


6 
a[o] = DDL = zit teI 4 ef6R/7) = ; (1 + 2cos =) = —0.1146 
r=0 


6 
Al = 5 So Hee = Sf el 4 e] = 


r=0 


> (a + 2cos 2) = 0.0792 


6 
ae is Sg 2 
h{2] = = Hee = rll +e G20/7 5932/7) = z ę + 2cos =) = 0.3209 
r=0 


6 
h[3] = DHe F = zi +141] = 0.4285 
r=0 


Similarly, we can show that 
h[4] = 0.3209, [5] = 0.0792, and Af6] = —0.01146 


Observe that h[k] is symmetrical about its center point k = 3 as expected. Compare these 
values with those found by the impulse invariance method in Table 12.3 for a rectangular 
window. Although the two sets of values are different, they are comparable. What is the 
difference in the two filters? The impulse invariance filter optimizes the design with respect 
to all frequencies. It minimizes the mean squared value of the difference between the desired 
and the realized frequency response. The frequency sampling method, in contrast, realizes 
a filter whose frequency response matches exactly to the desired frequency response at 
No uniformly spaced frequencies. The mean squared error in this design will generally be 
higher than that in the impulse invariance method. 
The filter transfer function is 


.0792 0.3209 0.4285 0.3209 0.0792 0.1146 
Hie] = -0.1146 + 20792 4 s paea E EES z 
z z z z z z 


__ —0.11462° + 0.079225 + 0.320924 + 0.42852? + 0.32092? + 0.07922 — 0.1146 
zê 


and 


He?“ = —0.1146 + 0.079277 + 0.3209e-77"7 + 0.428527 77 
+ 0.3209e 94"? + 0.07927 — 0.1146e 9%" 
= e7T {0.4285 + 0.6418 cos wT + 0.1584 cos 2wT — 0.2292 cos 3wT] 


The magnitude of this response (Fig. 12.21) shows that the realized filter values match 
exactly the desired response at the No sample points. The time delay adds a linear phase 
—3Tw to the filter characteristic. W 


© Computer Example C12.11 
Using MATLAB, find A{k} and the corresponding H [e*“7] for the frequency sampling 
filter in Example 12.12. 


NO=7; 
H=(110000 1); 
for i=1:N0 
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r=i-1; 
Hr(i)=H(i)*exp(-j*r*pi* (NO-1)/NO); 
end 
k=0:6 
hk=ifft(Hr); 
subplot(2,1,1); 
stem(k,hk); 
xlabel(’k’);ylabel(’h[k]’); 
M=512 
hE=[hk zeros(1,M-7)] 
HE=fft(hE); 
subplot(2,1,2); 
r=0:M-1; 
Wer.*2*pi/512 
plot(W,abs(HE)); 
xlabel(’W’);ylabel(’F (W)’);grid; (6) 


An Alternate Method Using Frequency Sampling Filters 


We now show an alternative approach to the frequency sampling method, which 
uses an No-order comb filter in cascade with a parallel bank of No — 1 first-order 
filters. This structure forms a frequency sampling filter. We start with Eqs. (6.55). 
The transfer function H [z] of the filter is first obtained by taking the z-transform 
of h|k] in Eq. (12.98): 


No-1 
H{z}= J. hfe] 
k=0 
1 No-1 S eke 
— Ha zF 
No ka lia 


1 Noxt Nol o, 
-$ Dm Lewy 
4 k=0 


r=0 


The second sum on the right-hand sìde is a geometric series, and using the result 
in B.7-4, we have 


No-1 —No,j2 
1 1 — 270g err 
TED | 


r=0 
Hence, 
No No~i 
zo — i1 zH, 
H|z| = — J errs 12.100) 
[z] No z™o r=0 z-i to ( 
Ay [z] 
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Observe that we do not need to perform IDFT (or IFFT) computations to obtain the 
desired filter transfer function. All we need is the values of the frequency samples 
H, , which are given. Equation (12.100) shows that the desired filter is realized as 
a cascade of two filters with transfer functions H,[z] and H a[z]. Also, Hy[z] is the 
transfer function of an No-order comb filter (see Example 12.9). The second filter 
with transfer function Hə[z] is a parallel combination of n + 1 first-order filters, 


whose poles lie on the unit circle at e Ne (r =0, 1, 2,---, No— 1). For the lowpass 
or bandpass filters many coefficients H, appearing in H[z] are zero. Recall that 
in Example 12.12 (lowpass filter) four out of seven coefficients are zero. Thus, in 
practice the final filter is usually much simpler than it appears in Eq. (12.100). As 
a result, this method may require a fewer number of computations (multiplications 
and additions) compared to those in the filter obtained by the direct method (using 
IDFT). 

The poles of the frequency sampling filter are complex in general because they 
lie on the unit circle. Therefore, we must combine the conjugate poles to form 
quadratic transfer functions to realize them. All these points will be clarified by 
designing the filter in Example 12.12 by this method. 


E Example 12.13 
Redo Example 12.12 using the method of frequency sampling filter. 
In this case n = 6, No =n +1 =7. Also 


Ho = H3 = Hy = Hs = 0 


and f . 
Ho = 1, H, = e796/7 Hs = e167/7 


Substituting these values in the transfer function H [2] of the desired filter in Eq. (12.100), 
we obtain 


27-1 z ze—J6"/7 zel6T/T 
Hfz] = - + - 
727 z-1l 9 z—e32m/7 © x e~52n/7 
Hy [2] 


H2[z] 


We combine the last two terms on the right-hand side corresponding to complex conjugate 
poles to obtain 


27-1 | z z(2z cos $£ — 2 cos a 
z 


-1 z? — (2 cos 2741) 


_ zal z 1.802z(z — 1) 
= z~1 z?—1.247z+1 
H2[z] 


We can realize this filter by placing the comb filter Hi, [z] in cascade with He[z], which 
consists of a first-order and a second-order filter in parallel. W 


Pole-Zero Cancellation in Frequency Sampling Filters 


In the method of frequency sampling filters, we make an intriguing observation 
that the required nonrecursive (FIR) filter is realized by a cascade of H 1[z] and 
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H2|z]. However, H2[z] is recursive (IIR). This strange fact should alert us to the 
possibility of something interesting going on in this filter. For a nonrecursive filter 
there can be no poles other than those at the origin [see Eq. (12.69a)]. In the 
frequency sampling filter [Eq. (12.100)], in contrast, Ho{z] has No poles at e47 
{r =0, 1, 2, ---, n). All these poles lie on the unit circle at equally spaced points. 
These poles simply cannot be in a nonrecursive filter. They must somehow get 
canceled along the way somewhere. This is precisely what happens. The zeros of 
H[z] are exactly where the poles of H2[z] are because 


zo | = (2 — ORS )(2 - eio )(z - eR)... (z — eirio) 


Thus, the poles of H2[z] are canceled by the zeros of H,{z], rendering the final filter 
nonrecursive. 

Pole-zero cancellation in this filter is a potential cause for mischief because 
such a perfect cancellation assumes exact realization of both Hy(z] and Ho{z]. Such 
a realization requires the use of infinite precision arithmetic, which is a practical 
impossibility because of quantization effects. Imperfect cancellation of poles and 
zeros means there will still be poles on the unit circle, and the filter will not have a 
finite impulse response. More serious, however, is the fact that the resulting system 
will be marginally stable. Such a system provides no damping of the round-off noise 
that is introduced in the computations. In fact, such noise tends to increase with 
time, and may render the filter useless. 

We can partially mitigate this problem by moving both the poles (of H2{z]) and 
zeros (of H;[z]) to a circle of radius r = 1 — e, where e is a small positive number 
— 0. This artifice will make the overall system asymptotically stable. 


Spectral Sampling with Windowing 


The frequency sampling method can be modified to take advantage of win- 
dowing. We first design a frequency sampling filter using a value No’ that is much 
higher than the design value No. The result is a filter that matches with the desired 
frequency response at a very large number (No’) of points. Then we use a suitable 
No-point window to truncate the No’-point impulse response. This procedure yields 
the final design of a desired order. 


12.9 Summary 


The response of an LTID system with transfer function H [z] to an everlasting 
sinusoid of frequency Q is also an everlasting sinusoid of the same frequency. The 
output amplitude is |He"]| times the input amplitude, and the output sinusoid is 
shifted in phase with respect to the input sinusoid by ZH {e3®] radians. The plot of 
|H [e?®]| vs Q indicates the amplitude gain of sinusoids of various frequencies and is 
called the amplitude response of the system. The plot of ZH [e19] vs Q indicates the 
phase shift of sinusoids of various frequencies and is called the phase response. The 
frequency response of an LTID system is a periodic function of 2 with period 27. 
This periodicity is the result of the fact that discrete-time sinusoids with frequencies 
differing by an integral multiple of 27 are identical. 

Frequency response of a system is determined by locations in the complex plane 
of poles and zeros of its transfer function. We can design frequency selective filters by 


778 12 Frequency Response and Digital Filters Problems 779 


proper placement of its transfer function poles and zeros. Placing a pole (or a zero) 
near the point e/%° in the complex plane enhances (or suppresses) the frequency 
response at the frequency Q = No. Using this concept, a proper combination of 
poles and zeros at suitable locations can yield desired filter characteristics. b) 

Digital filters are classified into recursive and nonrecursive filters. The duration 
of the impulse response of a recursive filter is infinite; that of the nonrecursive filter 
is finite. For this reason, recursive filters are also called infinite impulse response 
(IER) filters, and nonrecursive filters are called finite impulse response (FIR) filters. 

Digital filters can process analog signals using A/D and D/A converters. Pro- 
cedures for designing a digital filter that behaves like a given analog filter are dis- 
cussed. A digital filter can simulate the behavior of a given analog filter either 
in time-domain or in frequency-domain. This situation leads to two different de- 
sign procedures, one using a time-domain equivalence criterion and the other a 
frequency-domain equivalence criterion. 

For recursive or IIR filters, the time-domain equivalence criterion yields the 
impulse invariance method, and the frequency-domain equivalence criterion yields 
the bilinear transformation method. The impulse invariance method is handicapped 
by the aliasing problem, and cannot be used for highpass and bandstop filters. Fig. P12.1-1. 
The bilinear transformation method, which is generally superior to the impulse 
invariance method, suffers from the frequency scale warping effect. However, this 
effect can be neutralized by prewarping. 

For nonrecursive or FIR filters, the time-domain equivalence criterion leads to 
the method of windowing (Fourier series method), and the frequency-domain equiv- 
alence criterion leads to the method of frequency sampling. Because nonrecursive 
filters are a special case of recursive filters, we expect the performance of recursive 
filters to be superior. This statement is true in the sense that a given amplitude 
response can be achieved by a recursive filter of an order smaller than that required 
for the corresponding nonrecursive filter. However, nonrecursive filters have the fik] 
advantage that it can realize an arbitrarily shaped amplitude response and a linear 
phase characteristic. Recursive filters are good for a piecewise constant amplitude 
response and they can realize linear phase only approximately. To realize a linear 
phase characteristic in nonrecursive filters, the impulse response h[k] must be either 
symmetric or antisymmetric about its center point. 


(a) 


yik] 


References (b) 


1. Mitra, S.K., Digital Signal processing: A Computer-Based Approach, McGraw- 


Hill, New York, 1998. fik] yik] 


Fig. P12.1-2. 


Problems 


12.1-4 For an asymptotically stable LTID system, show that the steady-state response to in- 


12.1-1 Find the amplitude and phase response of the digital filters depicted in Fig. P12.1-1. ; an 
i P P $ E p put e?Fujk] is H|et?]e?Fu[k]. The steady-state response is that part of the response 


12.1-2 Find the amplitude and the phase response of the filters shown in Fig. P12.1-2. which does not decay with time and persists forever. 


oe ja ~j2.52 jû 
Hint: Express H[e”"] as e~7°°" Hafe” ]. Hint: Follow the procedure parallel to that used for continuous-time systems in Sec. 
12.1-3 For an LTID system specified by the equation 7.1-1. 


ylk + 1) — 0.5y{k] = f[k + 1] + 0-8f [k] 12.1-5 (a) A digital filter has the sampling interval T = 50yus. Determine the highest 


(a) Find the amplitude and the phase response. 
(b) Find the system response y[k] for the input f[k] = cos (0.5k — 3). 
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12.2-1 


12.2-2 


12.2-3 


12.2-4 
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frequency that can be processed by this filter without aliasing. 

(b) If the highest frequency to be processed is 50 kHz, determine the minimum value 
of the sampling frequency Fs, and the maximum value of the sampling interval T 
that can be used. 


Pole-zero configurations of certain filters are shown in Fig. P12.2-1. Sketch roughly 
the amplitude response of these filters. 


(a) 


(b) 


Fig. P12.2-1. 


(a) Realize a digital filter whose transfer function is given by 


Hie] = K et 
z-a 


(b) Sketch the amplitude response of this filter, assuming ja] < 1. 

(c) The amplitude response of this lowpass filter is maximum at 2 = 0. The 3-dB 
bandwidth is the frequency where the amplitude response drops to 0.707 (or 1/V2) 
times its maximum value. Determine the 3-dB bandwidth of this filter when a = 0.2. 


Design a digital notch filter to reject frequency 5000 Hz completely, and to have a 
sharp recovery on either side of 5000 Hz to a gain of unity. The highest frequency to 
be processed is 20 kHz (Fh = 20,000). Hint: See Example 12.3. The zeros should be 
at et”T for w corresponding to 5000 Hz, and the poles are at ae*“T with a < 1. 
Leave your answer in terms of a. Realize this filter using the canonical form. Find 
the amplitude response of the filter. 


Show that a first-order LTID system with a pole at z = r and a zero at z = 2 (r <1) 
is an allpass filter. In other words, show that the amplitude response |H [et®]] of a 
system with the transfer function 


zl 


H(z] = —— 


r i i 


r<l 


is constant with frequency. This is a first-order allpass filter. 

Hint: Show that the ratio of the distances of any point on the unit circle from the 
zero (at z = 4) and the pole (at z = r) is a constant +. 

Generalize this result to show that an LTID system with two poles at z = reti? and 
two zeros at z = teti? (r < 1) is an allpass filter. In other words, show that the 
amplitude response of a system with the transfer function 


_(z- tet? )(z — 4679?) Pe (2 cos 0)z + 4 


H : —— = 
l (z — re?®)(z — re~3®) ~ z2 — (2r cos 8)z +r? 


r<l 


is constant with frequency. 


— C—O 


Problems 


12.4-1 


12.5-1 


12.5-2 


12.5-3 


12.5-4 


12.5-5 


12.5-6 


12.5-7 
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(a) A lowpass digital filter with a sampling interval T = 50 ys has a cutoff frequency 
10 kHz. If the value of T in this filter is changed to 25 us, determine the new cutoff 
frequency of the filter. Repeat the problem if T is changed to 100 ps. 


(a) Using the impulse invariance criterion, design a digital filter to realize an analog 
filter with transfer function 
Ts + 20 
H, = — 
a(s) 2(s2 + 7s + 10) 


Assume the filter to be bandlimited to the frequency where the gain drops to about 
1% of its maximum value. 
(b) Show a canonical and a parallel realization of the filter. 


Using the impulse invariance criterion, design a digital filter to realize the second- 
order analog Butterworth filter with transfer function 


1 
s?4+V2s41 


Assume the filter to be bandlimited to the frequency where the gain drops to 1% of 
its maximum value. 


Ha(s) = 


Design a digital integrator using the impulse invariance method. Find and sketch the 
amplitude response, and compare it with that of the ideal integrator. If this integrator 
is used primarily for integrating audio signals (whose bandwidth is 20 kHz), determine 
a suitable value for T. 


An oscillator by definition is a source (no input) which generates a sinusoid of a 
certain frequency wo. Therefore an oscillator is a system whose zero-input response 
is a sinusoid of the desired frequency. Find the transfer function of a digital oscillator 
to oscillate at 10 kHz, by two methods: 

(a) Choose H[z] directly so that its zero-input response is a discrete-time sinusoid of 
frequency 2. = wT corresponding to 10 kHz. 

(b) Choose Ha(s) whose zero-input response is an analog sinusoid of 10 kHz. Now 
use the impulse invariance method to determine H [z]. 

In both methods select T so that there are 10 samples in each cycle of the sinusoid. 
(c) Show a canonical realization of the oscillator. 


A variant of the impulse invariance method is the step invariance method of digital 
filter synthesis. In this method, for a given Ha(s), we design H{z] in Fig. 12.8a such 
that y(kT) in Fig. 12.8b is identical to y[k] in Fig. 12.8a when f(t) = u(t). 

(a) Show that in general 


Hz] = ziz (Geo | 
t=kT. 


(b) Using this method, design H |z] when 
We 
S+We 


H,(s) = 


(c) Synthesize a discrete-time integrator using the step invariant method and compare 
its amplitude response with that of the ideal integrator. 

Synthesize a discrete-time differentiator and integrator, using the ramp invariance 
method. In this method, for a given Ha(s), we design H[z] such that y(kT) in Fig. 
12.8b is identical to y[k] in Fig. 12.8a when f(t) = tu(t). 

In an impulse invariance design, show that if Ha(s) is a transfer function of a stable 
system, the corresponding H Íz] is also a transfer function of a stable system. 
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12.6-1 


12.6-2 
12.6-3 


12.6-4 


12.6-5 


12.6-6 


12.6-7 


12.6-8 
12.6-9 


12.6-10 


12.7-1 


12.7-2 
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A pole of Ha(s) at s = si is transformed into a pole of H[z] at z = zi = e“*. Show 
that if Re s; < 0, then |z,| < 1. 


(a) Design a digital differentiator, using the bilinear transformation. 

(b) Show a realization of this filter. 

(c) Find and sketch the amplitude response of this filter and compare it with that of 
the ideal differentiator. 

(d) If this filter is used primarily for processing audio signals (voice and music) up 
to 20 kHz, determine a suitable value for T. 


Repeat Prob. 12.6-1 for a digital integrator. 


Design a digital lowpass Butterworth filter using the bilinear transformation with 
prewarping to satisfy the following specifications: Gp = —2 dB, G, = —11 dB, 
Wp = 100m rad/s, and ws = 200r rad/s. The highest significant frequency is 250 Hz. 
It is desirable to oversatisfy (if possible) the requirement of Gs. 


Repeat Prob. 12.6-3 for a chebyshev filter. 

Design a digital highpass Butterworth filter using the bilinear transformation with 
prewarping to satisfy the following specifications: Gp = —2 dB, G, = —10 dB, 
wp = 150r rad/s, and ws = 100r rad/s. The highest significant frequency is 200 Hz. 
Repeat Prob. 12.6-5 for a chebyshev filter. 

Design a digital bandpass Butterworth filter using the bilinear transformation with 
prewarping to satisfy the following specifications: Gp = —2 dB, G, = —12 dB, 
Wp, = 120 rad/s, wp, = 300 rad/s, and ws, = 45 rad/s, ws, = 450. The highest 
significant frequency is 500 Hz. 

Repeat Prob. 12.6-7 for a chebyshev filter. 

Design a digital bandstop Chebyshev filter using the bilinear transformation with 
prewarping to satisfy the following specifications: Gp = —1 dB, G,; = —22 dB, 
Wp, = 40 rad/s, wp, = 195 rad/s, and ws, = 80 rad/s, we, = 120. The highest 
significant frequency is 200 Hz. 

The bilinear transformation is actually a one-to-one mapping relationship between 
the s-plane and the z-plane. Show that the transformation 


z-1 


=K 
j z+1 


maps the jw-axis in the s-plane into a unit circle in the z-plane. The LHP and 
the RHP of the s-plane map into the interior and the exterior, respectively, of the 
unit circle in the z-plane. Show that if Ha(s) represents a stable system, then the 
corresponding H [z] also represents a stable system. 

Hint: s=o+jw and z = (K + s)/(K +s). 


Show that the frequency response of a third-order (n = 3) FIR filter with the impulse 
response h[|k] that is symmetric about its center point is given by 
A 5 1.5w T 3wT 
H [eT] = 2671 oF Ga cos > + h[0] cos Zr) 
and for the antisymmetric case 


H [eT] = 26147150T) (a) sin a + h{0] sin =T) 


Another form of comb filter is given by the transfer function 
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12.8-1 


12.8-2 


12.8-3 


12.8-4 


12.8-5 


(a) Find the impulse response of this filter for n = 6. 
(b) Find canonical realization of this filter. 
(c) Find and sketch the amplitude and phase response of this filter. 


(a) Design a nonrecursive (FIR) filter with n = 14 to approximate an ideal lowpass 
filter with a cutoff frequency at 20 kHz. Use the sampling frequency F, = 200 kHz. 
(b) Modify the design in (a), using the Hamming window. 


Using the impulse invariance method, design a tenth-order (n = 10) nonrecursive 
(FIR) filter to approximate the ideal bandpass characteristic depicted in Fig. P12.8- 
2. Use T = 2x 1073. 


Hgo) 


-1000 -800 0 00 ioo @ ase 


Fig. P12.8-2 


Determine |H[e?”7]|, using the von Hann window for a fifth-order nonrecursive (FIR) 
filter in Example 12.10 (to approximate an ideal lowpass filter) and for the tenth-order 
nonrecursive filter in Example 12.11 (to approximate an ideal differentiator). 


An ideal 7/2 phase shifter (also known as the Hilbert transformer) is given by 


—j 0O<S<w<r/T 


H a(jw) cg { 
0> w> -r/T 

(a) Sketch |Ha(jw)| and 2Ha(jw). 

(b) Using the impulse invariance method, design a fourteenth-order (N = 14) non- 

recursive (FIR) filter to approximate Ha(jw). Determine the resulting |H [e"”T]| and 

ZH{e?“7}, using the rectangular and the Hamming windows. 


Design a tenth-order digital differentiator in Example 12.11 using the frequency sam- 
pling method. Compare the values of this design with those found in Example 12.11 
using the impulse invariance method. 


State-Space Analysis | 


So far we have been describing systems in terms of equations relating certain 
output to an input (the input-output relationship). This type of description is 
an external description of a system (system viewed from the input and output 
terminals). As noted in Chapter 1, such a description may be inadequate in some 
cases, and we need a systematic way of finding system’s internal description. State 
space analysis of systems meets this need. In this method, we first select a set of 
key variables, called the state variables, in the system. The state variables have 
the property that every possible signal or variable in the system at any instant t 
can be expressed in terms of the state variables and the input(s) at that instant t. 
If we know all the state variables as a function of t, we can determine every possible 
signal or variable in the system at any instant with a relatively simple relationship. 
The system description in this method consists of two parts: 


1 Finding the equation(s) relating the state variables to the input(s) (the state 
equation). 

2 Finding the output variables in terms of the state variables (the output equa- 
tion). 

The analysis procedure, therefore, consists of solving the state equation first, 
and then solving the output equation. The state space description is capable of 
determining every possible system variable (or output) from the knowledge of the 
input and the initial state (conditions) of the system. For this reason it is an internal 
description of the system. 

By its nature, the state variable analysis is eminently suited for multiple-input, 
multiple-output (MIMO) systems. In addition, the state-space techniques are useful 
for several other reasons, including the following: 


1. Time-varying parameter systems and nonlinear systems can be characterized 
effectively with state-space descriptions. 

2. State equations lend themselves readily to accurate simulation on analog or 
digital computers. 

3. For second-order systems (n = 2), a graphical method called phase-plane 
analysis can be used on state equations, whether they are linear or nonlinear. 
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4. State equations can yield a great deal of information about a system even when 
they are not solved explicitly. 
This chapter requires some understanding of matrix algebra. Section B.6 is a 
self-contained treatment of matrix algebra, which should be more than adequate 
for the purposes of this chapter. 


13.1 Introduction 


From the discussion in Chapter 1, we know that to determine a system’s re- 
sponse(s) at any instant t, we need to know the system’s inputs during its entire 
past, from —oo to t. If the inputs are known only for t > to, we can still determine 
the system output(s) for any t > to, provided we know certain initial conditions 
in the system at t = to. These initial conditions collectively are called the initial 
state of the system (at t = to). 

The state of a system at any instant to is the smallest set of numbers 21(to), 


z2(to), ... , 2n(to) which is sufficient to determine the behavior of the system for 
all time t > tọ when the input(s) to the system is known for t > to. The variables 
T1, £2, ..., Zp are known as state variables. 


The initial conditions of a system can be specified in many different ways. 
Consequently, the system state can also be specified in many different ways. This 
means that state variables are not unique. The concept of a system state is very 
important. We know that an output y(t) at any instant t > to can be determined 
from the initial state {x(to)} and a knowledge of the input f(t) during the interval 
(to, t). Therefore, the output y(to) (at t = to) is determined from the initial state 
{z(to)} and the input f(t) during the interval (to, to). The latter is f (tọ). Hence, the 
output at any instant is determined completely from a knowledge of the system state 
and the input at that instant. This result is also valid for multiple-input, multiple- 
output (MIMO) systems, where every possible system output at any instant t is 
determined completely from a knowledge of the system state and the input(s) at 
the instant t. These ideas should become clear from the following example of an 
RLC circuit. 


E Example 13.1 


Find a state-space description of the RLC circuit shown in Fig. 13.1. Verify that 
all possible system outputs at some instant ¢ can be determined from a knowledge of the 
system state and the input at that instant t. 

It is known that inductor currents and capacitor voltages in an RLC circuit can be 
used as one possible choice of state variables. For this reason, we shall choose xı (the 
capacitor voltage) and z2 (the inductor current) as our state variables. 

The node equation at the intermediate node is 


ig = i1 — i2 — T2 
but i3 = 0.2ż1, i1 = 2(f — z1), i2 = 321. Hence 
0.21 = 2(f — z1) — 321 — x2 


or 
£1 = —25z1 — 522 + 10f 
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L 
2 


Fig. 13.1 RLC network for Example 13.1. 


This is the first state equation. To obtain the second state equation, we sum the voltages 
in the extreme right loop formed by C, L, and the 2 © resistor so that they are equal to 
Zero: 


—21 +424 222 = 0 
or 


£2 = T1 — 2x2 
Thus, the two state equations are 
tı = —252, — 5z2 + 10f (13.1a) 


t2 = T1 — 222 (13.1b) 


Every possible output can now be expressed as a linear combination of z1, 22, and f. 
From Fig. 13.1, we have 


u=f-x 

i = 2(f — 21) 

v2 = 21 

i2 = 321 

ig = i1 — i2 — zo = 2(f — 21) — 321 — T2 = —521 — T2 + 2f 
i4 = 22 


va = 2i4 = 222 


v3 = T1 — V4 = T3 — 222 (13.2) 


This set of equations is known as the output equation of the system. It is clear from 
this set that every possible output at some instant t can be determined from a knowledge 
of x1(t), za(t), and f(t), the system state and the input at the instant t. Once we solve the 
state equations (13.1) to obtain 21(¢) and r2(t), we can determine every possible output 
for any given input f(t). W 


If we already have a system equation in the form of an nth-order differential 
equation, we can convert it into a state equation as follows. Consider the system 
equation 

dy d”`ly dy 


ûn-1 +- +a 


2 Eon = f(t 13.3 
a tent Gan a toy =F (13.3) 
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One possible set of initial conditions is y(0), y(0), ... , y~)(0). Let us define y, 
ý, ğ, -.. , yT) as the state variables and, for convenience, let us rename the n 
state variables as 23, 22, .-. , En: 

ry>=y 

r2=y 

z3=ğ 

En zy) (13.4) 


According to Eq. (13.4), we have 


t1 = T2 
T2 = T3 
In-1 = Tn 
and, according to Eq. (13.3), 
En = —An—1Zn — On—2Zn—-1 — +++ — @1ZQ — agri + f (13.5a) 


These n simultaneous first-order differential equations are the state equations 
of the system. The output equation is 


y= 21 (13.5b) 


For continuous-time systems, the state equations are n simultaneous first-order 
differential equations in n state variables z1, £2, ... , Zn of the form 


ti = gi(21,22,.--,2n, fi, fo- fj) += 1,2,...,n 


where f1, fo,--. , fn are the j system inputs. For a linear system, these equations 
reduce to a simpler linear form 


Èk = ak1£1 + akota + +++ + aknEn + bkifi + beefe +- + bkjfj k=1,2,...,7 
(13.6a) 
and the output equations are of the form 


Ym = CmiZ1+Cm2t2+++-+mnInt+dmifitadmafet: --+dmjfj m = 1,2,...,k 
( 


The set of Equations (13.6a) and (13.6b) is called a dynamical equation. When 
it is used to describe a system, it is called the dynamical-equation description 
or state-variable description of the system. The n simultaneous first-order state 
equations are also known as the normal-form equations. 

These equations can be written more conveniently in matrix form: 
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PA ail a12 ` ln ea bu biz oo bij Fi 
on a21 422 ann | | xo b21 b22 baj fo 
= + (13.7a) 
in Anl an2 ann In bni bn2 bnj fj 
x ——— x Pa f 
and 
ji cu e2 ooo Cin] Fe dy, dig >- dij fi 
yo C2} C22 t COn T d21 d22 --- da; h 
= + (13.7b) 
i Cki Ck? co Ckn | |g dky dk2 `> dj fi 
——’ Se i 
y z x X f 
or 
x= Ax + Bf (13.8a) 
y=Cx+Df (13.8b) 


Equation (13.8a) is the state equation and Eq. (13.8b) is the output equation. The 
vectors x, y, and f are the state vector, the output vector, and the input vector, 


respectively. 
For discrete-time systems, the state equations are n simultaneous first-order 
difference equations. Discrete-time systems are discussed in Sec. 13.6. 


13.2 A Systematic Procedure for Determining State Equations 


We shall discuss here a systematic procedure for determining the state-space 
description of linear time-invariant systems. In particular, we shall consider two 
types of systems: (1) RLC networks and (2) systems specified by block diagrams 
or nth-order transfer functions. 


13.2-1 Electrical Circuits 


The method used in Example 13.1 proves effective in most of the simple cases. 


The steps are as follows: 
1. Choose all independent capacitor voltages and inductor currents to be the 


state variables. 
2. Choose a set of loop currents; express the state variables and their first 


derivatives in terms of these loop currents. 
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22 1H 1Q 


Fig. 13.2 RLC network for Example 13.2. 


3. Write the loop equations and eliminate all variables other than state vari- 
ables (and their first derivatives) from the equations derived in Steps 2 and 3. 


|_| Example 13.2 

Write the state equations for the network shown in Fig. 13.2. 

Step 1. There is one inductor and one capacitor in the network. Therefore, we shall 
choose the inductor current zı and the capacitor voltage x2 as the state variables. 

Step 2. The relationship between the loop currents and the state variables can be 
written by inspection: 


zı = i2 (13.9a) 
iiz = i2 — ig (13.9b) 
Step 3. The loop equations are l 
4i — 2i2 = f (13.10a) 
2(iz — i1) + 1 +22 = 0 (13.10b) 
—22 + 3iz3 = 0 (13.10c) 


Now we eliminate i1, i2, and iz from Eqs. (13.9) and (13.10) as follows. From Eq. (13.10b), 
we have 


tı = 2(t1 — i2) — 2 
We can eliminate i; and i2 from this equation by using Eqs. (13.9a) and (13.10a) to obtain 
ii =—21—22+ if 
The substitution of Eqs. (13.9a) and (13.10c) in Eq. (13.9b) yields 
t2 = 22; — 220 


These are the desired state equations. We can express them in matrix form as 


eer ak 
= +° (13.11) 
iz 2 -4 T2 0 


The derivation of state equations from loop equations is facilitated considerably by 
choosing loops in such a way that only one loop current passes through each of the inductors 
or capacitors. E 
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An Alternative procedure 


We can also determine the state equations by the following procedure: 

1. Choose all independent capacitor voltages and inductor currents to be the 
state variables. 

2. Replace each capacitor by a fictitious voltage source equal to the capacitor 
voltage, and replace each inductor by a fictitious current source equal to the inductor 
current. This step will transform the RLC network into a network consisting only 
of resistors, current sources, and voltage sources. 

3. Find the current through each capacitor and equate it to Cz;, where z; is 
the capacitor voltage. Similarly, find the voltage across each inductor and equate 
it to Lz;, where x; is the inductor current. 


Fig. 13.3 Equivalent circuit of the network in Fig. 13.2. 


B Example 13.3 

Using the above procedure, write the state equations for the network in Fig. 13.2. 

In the network in Fig. 13.2, we replace the inductor by a current source of current 21 
and the capacitor by a voltage source of voltage z2, as shown in Fig. 13.3. The resulting 
network consists of five resistors, two voltage sources, and one current source. We can 
determine the voltage vz across the inductor and the current i, through the capacitor by 
using the principle of superposition. This step can be accomplished by inspection. For 
example, vz has three components arising from three sources. To compute the component 
due to f, we assume that zı = 0 (open circuit) and z2 = 0 (short circuit). Under these 
conditions, all of the network to the right of the 22 resistor is opened, and the component 
of vz due to f is the voltage across the 22 resistor. This voltage is clearly 3 f- Similarly, 
to find the component of vz due to x1, we short f and x2. The source z1 sees an equivalent 
resistor of 1Q across it, and hence vz, = —2x1. Continuing the process, we find that the 
component of vz due to x2 is —x2. Hence 


vL = ti = sf — 21-22 (13.12a) 
Using the same procedure, we find 
1 1 
t= 3% = gjs 372 (13.12b) 


— 
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These equations are identical to the state equations (13.11) obtained earlier; W 


13.2-2 State Equations From Transfer Function 


It is relatively easy to determine the state equations of a system specified by 
its transfer function. Consider, for example, a first-order system with the transfer 
function 

1 
sta 
The system realization appears in Fig. 13.4. The integrator output serves as a 
natural state variable since, in practical realization, initial conditions are placed on 
the integrator output. From Fig. 13.4, we have 


H(s) = (13.13) 


i 


ll 


—ar + f (13.14a) 


y=r (13.14b) 


Fig. 13.4 


In Sec. 6.6 we saw that a given transfer function can be realized in several ways. 
Consequently, we should be able to obtain different state-space descriptions of the 
same system by using different realizations. This assertion will be clarified by the 
following example. 


E Example 13.4 
Determine the state-space description of a system specified by the transfer function 


2s + 10 
H(s) = ——— 13. 
(s) s + 8s? + 19s + 12 (13.15a) 
2 s+5 1 
- CEPS a 
EJE (13.15b) 
4 2 2 
ee eee 3 13. 
s+1 ata oe (13.15) 


{This procedure requires modification if the system contains all-capacitor voltage source tie sets 
or all-inductor current source cut sets. In the case of all-capacitor voltage source tie sets, all 
capacitor voltages cannot be independent. One capacitor voltage can be expressed in terms of 
the remaining capacitor voltages and the voltage source(s) in that tie set. Consequently, one of 
the capacitor voltages should not be used as a state variable, and that capacitor should not be 
replaced by a voltage source. Similarly, in all-inductor current source tie sets, one inductor should 
not be replaced by a current source. If there are all-capacitor tie sets or all-inductor cut sets only, 
no further complications occur. In all-capacitor-voltage source tie sets and /or all-inductor-current 
source cut sets, we have additional difficulties in that the terms involving derivatives of the input 
may occur. This problem can be solved by redefining the state variables. The final state variables 
will not be capacitor voltages and inductor currents. 
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(2) 
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Fig. 13.5 Canonical, cascade, and parallel realizations of the system in Example 13.4. 
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Using the procedure developed in Sec. 6.6, we shall realize H(s) in Eq. (13.15) with 
four different realizations: (i) the controller canonical form [Eq. (13.15a)}, (ii) the observer 
canonical form (Eq. (13.15a)}, (iii) cascade realization [Eq. (13.15b)] and (iv) parallel re- 
alization [Eq. (13.15c)]. These realizations are depicted in Figs. 13.5a, 13.5b, 13.5c, and 
13.5d, respectively. As mentioned earlier, the output of each integrator serves as a natural 
state variable. 


1. Canonical Forms 


Here we shall realize the system using the first (controller) canonical form discussed 
in Sec. 6.6-1. If we choose the state variables to be the three integrator outputs 21, £2, 
and z3, then, according to Fig. 13.5a, 


D1 = T2 
2 = T3 (13.16a) 
t3 = —12r; — 1922 — 8234+ f 


Also, the output y is given by 
y = 1021 + 2x2 (13.16b) 


Equations (13.16a) are the state equations, and Eq. (13.16b) is the output equation. In 
matrix form we have 


tı 0 1 0 Tı 0 
t2 | = 0 0 1 z2/+/0lf (13.17a) 
t3 —12 -19 -8 T3 1 
and 5 B 
Ti 
y=[10 2 0]ļ|z2 (13.17b) 
Neen a 
c s 


We can also realize H (s) by using the second (observer) canonical form (discussed in 
Appendix 6.1), as shown in Fig. 13.5b. If we label the output of the three integrators from 
left to right as the state variables v1, v2, and v3, then, according to Fig. 13.5b, 


ùi = —12v3 + 10f 
v2 = vı — 193 + 2f (13.18a) 
bg = v2 — 83 


and the output y is given by 


y = v3 (13.18b) 
Hence 
01 0 0 -12 v1 10 
tz} = ]1 0 -19 ve} +]2]f (13.19a) 
03 0 1 -8 v3 0 
— w 
A B 
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and 
v1 
y=[0 0 1] |v (13.19b) 
eee 
c v3 


Observe closely the relationship between the state-space descriptions of H (s) that use 
the controller canonical form [Eqs. (13.17)] and those using the observer canonical form 
[Eqs. (13.19)]. The A matrices in these two cases are the transpose of one another; also, 
the B of one is the transpose of C in the other, and vice versa. Hence 


(A)? =A 
(B) =° (13.20) 
(C) =Ê 


This is no coincidence. This duality relation is generally true.’ 


2. Series Realization 


The three integrator outputs wi, w2, and w3 in Fig. 13.5c are the state variables. 
The state equations are 


w= -wi +f (13.21a) 
we = 2w — 3we (13.21b) 
w3 = 5w2 + the ~ 4w3 (13.21c) 
and the output equation is 
y = w3 


The elimination of w2 from Eq. (13.21c) by using Eq. (13.21b) converts these equations 
into the desired state form 


W1 -l 0 0 Wi 1 
we} =] 2 -3 0 wo) + {of (13.22a) 
w3 2 2 —4 w3 0 
and 
Wi 
y=[0 0 1] | we (13.22b) 
W3 


3. Parallel Realization (Diagonal Representation) 


The three integrator outputs z1, z2, and z3 in Fig. 13.5d are the state variables. The 
state equations are 


a=-atf 
ża = —322 + f 
33 = —4z3 + f (13.23a) 


S 
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and the output equation is 
y= fz ~ 2z2 + 2z (13.23b) 


Therefore, the equations in the matrix form are 


aa -1 0 O07] fa 1 
żļ=ļ]|0 -3 O|] |zl+ ilf (13.24a) 
tn 0 0 -4] [zs 1 
zı 
y=[2 -2 2] ] 22 (13.24b) 
23 
E 


© Computer Example C13.1 

Solve Example 13.4 using MATLAB. 

Caution: The convention of MATLAB for labeling state variables x1, £2, ..., £n ina 
block diagram, such as shown in Fig. 13.5a, is reversed. What we label xı is £n, and z2 is 
Zn—1, and so on. 


num=(2 10]; den=[1 8 19 12]; 

[A,B,C,D]=tf2ss(num,den) 

% In order to find the transfer function from A, B, C, and D, use 
{num, den]=ss2tf(A,B,C,D) 

printsys(num,den) (©) 


A General Case 


It is clear that a system has several state-space descriptions. Notable among 
these are the canonical-form variables and the diagonalized variables (in the parallel 
realization). State equations in these forms can be written immediately by inspec- 
tion of the transfer function. Consider the general nth-order transfer function 


H(s) = bms™ + bm-1s™ 1 + --- + bis + bo (13.252) 
s” + an_18"-1 + +--+ ays +9 ` 
bms™ +bm-185™} +- - +b1s + bo 
(s — A1)(s — A2) ++- (8 — An) 
kı + k2 P kn 
s — ài s— 2 8— Àn 


ll 


(13.25b) 


Figures 13.6a and 13.6b show the realizations of H(s), using the controller 
canonical form [Eq. (13.25a)] and the parallel form (Eq. (13.25b)], respectively. 

The n integrator outputs z1, 12, ... , Zn in Fig. 13.6a are the state variables. 
It is clear that 


T1 = T2 

T2 = T3 
ENEE (13.26a) 
fn-1 = In 


En = —an-—1Tn — On-2En—] — ` — 01T2 — 0971+ f 
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Fig. 13.6 Controller canonical and parallel realizations for an nth order LTIC system. 


and output y is 


y= bozi + biz + --- + bmEm+1 (13.26b) 
or 
Ly 0 1 0 0 zı 0 
T2 0 0 1 0 0 T2 0 
= a E E A E E Seats eee + f 

En-1 0 0 0 0 1 En-1 0 
£ —ag —-@, —a2 —ün—-2 —An-1 T 1 

j oa i i i (13.27a) 


and 


ee 
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T1 
T2 

y =[bo bi >- bm O --- 0] (13.27b) 
In 


Observe that these equations (state equations and output equation) can be written 
immediately by inspection of H (s). 

The n integrator outputs z1, z2,... , Zn in Fig. 13.6b are the state variables. 
It is clear that 


žı = àz + f 
dg = Anza + f 
ablo dts (13.28a) 
Zn =Anin+f 
and 
y = kizi + kozgt---+kpnzn (13.28b) 
or 
zı à 0 0 0 zı 1 
22 0 2 0 0 z2 1 
EERE lah vane sa ee cee (13.29a) 
Zn-1 0 0 An-1 0 Zn-1 1 
Zn 0 0 0 An Be 1 
and 
2] 
22 
y=([ki ko = kat kaj] : (13.29b) 
Zn-1 
Zn 


The state equation (13.29a) and the output equation (13.29b) can be written 
immediately by inspection of the transfer function H (s) in Eq. (13.25b). Observe 
that the diagonalized form of the state matrix [Eq. (13.29a)} has the transfer func- 
tion poles as its diagonal elements. The presence of repeated poles in H (s) will 
modify the procedure slightly. The handling of these cases is discussed in Sec. 6.6. 
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Fig. 13.7 Realization of a second-order system. 


It is clear from the above discussion that a state-space description is not unique. 
For any realization of H(s) using integrators, scalar multipliers, and adders, a corre- 
sponding state-space description exists. Since there are many possible realizations 
of H(s), there are many possible state-space descriptions. 


Realization 


Consider a second-order system with a single input f, a single output y, and 
two state variables, zı and z2. The system equations are 


2, = 41121 + 0,272 + bif 


£q = a211) + agora + bef (13.30a) 
and 


y = 121 + c232 + df (13.30b) 


Figure 13.7 shows the block diagram of the realized system. The initial conditions 
21(0) and z2(0) should be applied at Nj and Ng. This procedure can be easily 
extended to general multiple-input, multiple-output systems with n state variables. 


13.3 Solution of State Equations 


The state equations of a linear system are n simultaneous linear differential 
equations of the first order. We studied the techniques of solving linear differential 
equations in Chapters 2 and 6. The same techniques can be applied to state equa- 
tions without any modification. However, it is more convenient to carry out the 
solution in the framework of matrix notation. 


13.3 Solution of State Equations 


a 


799 


These equations can be solved in both the time domain and frequency domain 
(Laplace transform). The latter requires fewer new concepts and is therefore easier 
to deal with than the time-domain solution. For this reason, we shall first consider 


the Laplace transform solution. 


13.3-1 Laplace Transform Solution of State Equations 
The kth state equation {Eq. (13.6a)] is of the form 


ik = Ont. + ak2T2 +--+ aknEn + br fi + beafa t+ +bkjfj 


We shall take the Laplace transform of this equation. Let 


t) <> X 
so that zalt) r(s) 


ER(t) <=> sX - 0 
ae z(t) sXx(s) — zx(0) 


fi(t) => F;(s) 
The Laplace transform of Eq. (13.31a) yields 


sXp(s) — ce(O) = an, X1(s) + ak2 X2(8) +---+ @knXn(s) + ber Fi (s) 
+ beoFo(s) +--+ + bkjF;(8) 


Taking the Laplace transforms of all n state equations, we obtain 


X1(s) z1(0) aiy 412 °°" Gin | F X4(s) 
X2(s) z2(0) a21 022 `o 2n | | als) 
s = = 
Xn(s) zn(0) Qn1 an2 ` Ann Xn(s) 
y y 1——— 
X(s) x(0) 4 Xs) 
bi biz > bij] [ Fils) 
ba, b22 b2; | | Fo(s) 
+ 
bni bn2 bnj F;(s) 
B F(s) 


Defining the vectors, as indicated above, we have 
sX(s) — x(0) = AX(s) + BF(s) 
or 


sX(s) - AX(s) = x(0) + BF(s) 
and 


(13.31a) 


(13.31b) 


(13.32a) 
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(sI — A)X(s) = x(0) + BF(s) (13.32b) 


where I is the n x n identity matrix. From Eq. 13.32b, we have 


X(s) = (s1 ~ A)~*[x(0) + BF(s)] (13.33a) 
= &(s)[x(0) + BF(s)] (13.33b) 
where 
(s) = (sI— A)! (13.34) 
Thus, from Eq. (13.33b), 
X(s) = &(s)x(0) + ®(s)BF(s) (13.35a) 
and 
x(t) = L7'{®(s)|x(0) + L-}|6(s)BF(s)] (13.35b) 


zero-input component zero-state component 


Equation (13.35b) gives the desired solution. Observe the two components of the 
solution. The first component yields x(t) when the input f(t) = 0. Hence the 
first component is the zero-input component. In a similar manner, we see that the 
second component is the zero-state component. 


E Example 13.5 
Find the state vector x(t) for the system whose state equation is given by 


x=Ax+Bf 


eS 
A= B= f(t) = u(t) 
—36 -l1 1 


and the initial conditions are zı(0) = 2, r2(0) = 1. 
From Eq. (13.33b), we have 


X(s) = &(s)[x(0) + BF(s)] 
Let us first find @(s). We have 


1 0 -12 3 s+12 -2 
(sI- A) =s = = 
0 1 -36 -1 36 stl 


s+1 2/3 
Ti (s+4)(s+9)  (s+4)(s+9) 
(s) =(sI- A) = (13.36a) 


—36 s+12 
(sF4)649)  (s+4)(s+9) 


where 


and 


Now, x(0) is given as 


Also, F(s) = 4, and 


Therefore 


13.3 Solution of State Equations 


a _ [See 
soara =| ‘|-| a 
1+ 


and 


X(s) = &(s)[x(0) + BF(s)] 
2 
+1 ki 6s+1 
GTDC) (s+4)(s+9) | 3 
=36 12 
(s+4)(s+9) Grae) 
25743341 
s(s+4)(s+9) 
3—59 
(s+4)(s+9) 
1 21 236 


The inverse Laplace transform of this equation yields 


xi (t) (3 -pe “+ Me™ le 
= (13.36b) 
x2(t) 63,—4t | 68,—9t 
-3e “+ Fe u(t) 


© Computer Example C13.2 
Solve Example 13.5 using MATLAB. 
Caution: See caution in Example C13.1. 
A=[-12 2/3;-36 -1]; B=[1/3; 1}; 
C=[0 0}; D=0; 
x0=[251]; 
t=0:.01:3; t=t’; 
f=ones(length(t),1); 
[y,x]=Isim(A,B,C,D,f,t,x0); 
plot(t,x) © 


The Output 


The output equation is given by 


y =Cx+Df 
and 


Y(s) = CX(s) + DF(s) 


The substitution of Eq. (13.33b) into this equation yields 


802 13 State-Space Analysis 


Y(s) = C{#(s)[x(0) + BF(s)]} + DF(s) 


= C&(s)x(0) +(C4(s)B + D]F(s) (13.37) 
— — am 
zero-input response zero-state response 


The zero-state response (that is, the response Y (s) when x(0)=0), is given by 


Y(s) = [C®(s)B + D]F(s) (13.38a) 


Note that the transfer function of a system is defined under the zero-state condition 
[see Eq. (6.53)]. The matrix C@(s)B + D is the transfer function matrix H(s) 
of the system, which relates the responses y1, y2, --. , yk to the inputs f1, fo, ... , 


fy: 


H(s) = C&(s)B+D (13.38b) 


and the zero-state response is 
Y(s) = H(s)F(s) (13.39) 


The matrix H(s) is a k x j matrix (k is the number of outputs and j is the number 
of inputs). The ijth element H;;(s) of H (s) is the transfer function that relates the 
output y;(t) to the input f;(t). 


E Example 13.6 
Let us consider a system with a state equation 


ELEU = 


and an output equation 


yı 1 0 0 0 
zı fi 
yl=]1 1 +]1 0 (13.40b) 
T2 fa 
ys 0 2 0 1 
In this case, 
1 0 0 0 
0 1 1 0 
A= B= C=]ļ]1 1 D=j]1 0 (13.40c) 
-2 -3 11 
0 2 0 1 
and 


(13.41) 


s+3 1 
(s+1Xs+2) (s+1)(s+2} 
2 s+3 


~1 
D s -l 

&(s)=(sI- A) = | = o i 

GHI +2)  (s+1)(s +2) 


Hence, the transfer function matrix H(s) is given by 


SS ee 
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H(s) = C(s)B + D 


1 0 0 0 
s+3 L 
GED emey] 0 
= |41 1 + ]1 0 
GAED mema] |l 1 
0 2 0 1 
s44 1 
4 1 
=| & 7 (13.42) 


2(s-2) 8745342 
(st1)(st2) — (s+1)(s+2) 


and the zero-state response is 
Y(s) = H(s)F(s) 


Remember that the ijth element of the transfer function matrix in Eq. (13.42) represents 
the transfer function that relates the output y:(t) to the input f;(t). Thus, the transfer 
function that relates the output y3 to the input fo is H32(s), where 


s?+5s+2 a 


Hal) = Gy ie +2) 


© Computer Example C13.3 

Solve Example 13.6 using MATLAB. 

Caution: The common factor (s + 1) in two of the transfer functions in Eq. (13.42) 
are canceled. The MATLAB answer gives transfer function with common factor. 


A=[0 1;-2 -3]; B=[1 0;1 1]; 

C=[1 0;1 1;0 2]; D=[0 0;1 0;0 1}; 
[num1,den1]=ss2tf(A,B,C,D,1) 
{num2,den2]=ss2tf(A,B,C,D,2) © 


Characteristic Roots (Eigenvalues) of a Matrix 


It is interesting to observe that the denominator of every transfer function in 
Eq. (13.42) is (s + 1)(s + 2) with the exception of H21(s) and H2(s), where the 
cancellation of the factor (s+ 1) occurs. This fact is no coincidence. We see that the 
denominator of every element of ®(s) is |sI~ A| because @(s) = (sI— A)~!, and the 
inverse of a matrix has its determinant in the denominator. Since C, B, and D are 
matrices with constant elements, we see from Eq. (13.38b) that the denominator 
of (s) will also be the denominator of H(s). Hence, the denominator of every 
element of H(s) is |sI — A|, except for the possible cancellation of the common 
factors mentioned earlier. In other words, the poles of all transfer functions of 
the system are also the zeros of the polynomial |sI — A|. Therefore, the zeros 
of the polynomial |sI — A| are the characteristic roots of the system. Hence, the 
characteristic roots of the system are the roots of the equation 


jsi -— AJ =0 (13.43a) 


804 13 State-Space Analysis 


Since |sI — A| is an nth-order polynomial in s with n zeros 41, 2, --- , An, We can 
write Eq. (13.43a) as 


|sI — A| = s” +an_is"t) +--+ ais + a9 


= (s — A1)(s — A2)--- (s — An) = 0 (13.43b) 
For the system in Example 13.6, 
s 0 0 1 
|sI-— A| = — 
0 s -2 -3 
s -l 
2 s+3 
=s +3s+2 (13.44a) 
= (s + 1)(s +2) (13.44b) 


Hence 
à= -—1 and à2=-—2 


Equation (13.43) is known as the characteristic equation of the matrix A, 
and ài, 2, .-- , An are the characteristic roots of A. The term eigenvalue, 
meaning “characteristic value” in German, is also commonly used in the literature. 
Thus, we have shown that the characteristic roots of a system are the eigenvalues 
(characteristic values) of the matrix A. 

At this point, the reader will recall that if \1, Ag, --- , An are the poles of the 
transfer function, then the zero-input response is of the form 


yo(t) = cxe™* + cge™? + +++ + cne™™t (13.45) 


This fact is also obvious from Eq. (13.38). The denominator of every element of 
the zero-input response matrix C®(s)x(0) is |sI — A| = (s — A1)(s - à2) (s - 
An). Therefore, the partial-fraction expansion and the subsequent inverse Laplace 
transform will yield a zero-input component of the form in Eq. (13.45). 

13.3-2 Time-Domain Solution of State Equations 


The state equation is 
x = Ax + Bf (13.46) 


We now show that the solution of the vector differential Equation (13.46) is 
t 
x(t) = eAtx(0) + J eAC—BE(r) dr (13.47) 
0 


Before proceeding further, we must define the exponential of the matrix appearing 
in Eq. (13.47). An exponential of a matrix is defined by an infinite series identical 
to that used in defining an exponential of a scalar. We shall define 


A??? A323 A"? 


eñt = 1+ At + = + Het +e (13.48a) 
2! 3! n! 
© kek 
-D&r (13.48b) 


ooo a a a 
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Thus, if 
0 1 
A= 
2 1 
then 
0 1 0 t 
At = t= (13.49) 
2 1 2t t 
and A l 
az2 [o gp ge poje JP $ 
= A L= (13.50) 
2! PALO aj? q2 BS [e æ 
and so on. 


We can show that the infinite series in Eq. (13.48) is absolutely and uniformly 
convergent for all values of t. Consequently, it can be differentiated or integrated 
term by term. Thus, to find (d/dt)e®t, we differentiate the series on the right-hand 
side of Eq. (13.48a) term by term: 


d nt a A3% AP 
qe SAT Att SR 4+ (13.51a) 
AP A343 
=a [rears SE iar +] 
= Ae™ (13.51b) 


Note that the infinite series on the right-hand side of Eq. (13.51a) also may be 
expressed as 


d at A’? a3 
= A ee ee 
a [r+ bp gyre tt A 
=eAta 
Hence 
d 
ae = AeA? = e^tA (13.52) 


Also note that from the definition (13.48a), it follows that 


e° =I (13.53a) 


a 


If we premultiply or postmultiply the infinite series for e^* [Eq. (13.48a)] by an 
infinite series for e~“*, we find that 


where 


(e~At)(eAt) a (eA*)(e~A*) =I (13.53b) 
Tn Sec. B.6-3, we show that 
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d dP 
ale aa p— 
dt (PQ) dt Q+ dt 


Using this relationship, we observe that 
d 
a -Aty = ( —eA* |x +e Ate 
dt dt 
= -e^ Ax + e^t (13.54) 
We now premultiply both sides of Eq. (13.46) by e7At to yield 


e Aty =e AtAx+e“Bf (13.55a) 
or 


e Ate — e AtAx =e “'BE (13.55b) 


A glance at Eq. (13.54) shows that the left-hand side of Eq. (13.55b) is $[e7^*]. 


Hence 
2 [e~At] = e7^tBf 
dt 


The integration of both sides of this equation from 0 to t yields 


t 
eWAty| = J eA’ Bf(r) dr (13.56a) 
or 0 ; 
e Atx(t) — x(0) = l eA’ BE(r) dr (13.56b) 
Hence S 
t 
e~Aty = x(0) +f e A’ Bf(r) dr (13.56c) 
0 


Premultiplying Eq. (13.56c) by e^t and using Eq. (13.53b), we have 


t 
x(t) = eAtx(0) + f e^t- BE(r) dr (13.57) 
—— o 
zero-input component < 
zero-state component 
This is the desired solution. The first term on the right-hand side represents z(t) 
when the input f(t) = 0. Hence it is the zero-input component. The second term, 
by a similar argument, is seen to be the zero-state component. 

The results of Eq. (13.57a) can be expressed more conveniently in terms of the 
matrix convolution. We can define the convolution of two matrices in a manner 
similar to the multiplication of two matrices, except that the multiplication of two 
elements is replaced by their convolution. For example, 


& ‘| j "| H *gı + f2*g3) (fı*g92+ fo*ga) 
* = 
fs fa 93 94 (f3 *g1 + fa*g3) (f3 *g2+ fa* ga) 


Using this definition of matrix convolution, we can express Eq. (13.57a) as 


a N 
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x(t) = e™x(0) + e^ * BE(t) (13.57b) 


Note that the limits of the convolution integral [Eq. (13.57a)}] are from 0 to t. 
Hence, all the elements of e^* in the convolution term of Eq. (13.57b) are implicitly 
assumed to be multiplied by u(t). 

The result of Eq. (13.57) can be easily generalized for any initial value of t. It 
is left as an exercise for the reader to show that the solution of the state equation 
can be expressed as 


t 
x(t) = Aitak) + | MOBE) dr (13.58) 
ti 


Oo 


Determining e^t 


The exponential e^t required in Eq. (13.57) can be computed from the defini- 
tion in Eq. (13.5la). Unfortunately, this is an infinite series, and its computation 
can be quite laborious. Moreover, we may not be able to recognize the closed-form 
expression for the answer. There are several efficient methods of determining e^ 
in closed form. It is shown in Sec. B.6-5 that for an n x n matrix A, 


e^t = Bol + BA + BoA? +--+ + Bn A"! (13.59a) 
where 
Bo 1 Ay Az ee AIJ eat 
By 1 àz AB Agr! erst 
Bn-1 1 An AR ves AR ernt 
and Ai, A2,..., An are the n characteristic values (eigenvalues) of A. 


We can also determine e“* by comparing Eqs. (13.57a) and (13.35b). It is clear 
that 


e^t = £-"[8(s)] (13.59b) 
= £7{(sI — A)7}] (13.59c) 


Thus, e“* and ®(s) are a Laplace transform pair. To be consistent with Laplace 
transform notation, e“* is often denoted by ¢(t), the state transition matrix 
(STM): 


e^t T élt) 


E Example 13.7 
Find the solution to the problem in Example 13.5 using the time-domain method. 
For this case, the characteristic roots are given by 


s+12 -3 


jsI— A[ = =s? + 13s +36 = (s +4)(s +9) =0 


36 s+1 
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The roots are \1 = —4 and A2 = —9, so 
Bo 1 4] fet] 4 [9e~* — 4e” 
Bs E 1 -9 e-t = ent e7? 
e^t = Bol + fA 
a 2 
9 a 4 ot 10 1 -at 1 -ot 2 4 
se — -e + Be = 5° 
5 5 01 -36 -1 


-3,-4t , 8,~9t 2 /,-4t _ „9t 
(# +§e ) is (e em) 


and 


Il 


= (13.60) 
(et + e~*) (i = ge) 
The zero-input component is given by {see Eq. (13.57a)] 
(-te“ 4 ge) (e = e~%) 3 
e“*x(0) = | | 
3 (—e7* + et) (te as re) 1 
(sa + ge) u(t) 
= (13.61a) 


(ee + ge) u(t) 


Note the presence of u(t) in Eq. (13.61a), indicating that the response begins at t = 0. 
The zero-state component is e^ + Bf [see Eq. (13.57b)], where 


H Bi 
Bf = u(t) = 
1 u(t) 


Bet 4 Se ult) Ze —e™u(t) & 


38 (e74 +e7*u(t)) (2e~* - 3e7* u(t) u(t) 


and 
e^ x B&(t) = | 


Note again the presence of the term u(t) in every element of ‘e^, This is the case because 
the limits of the convolution integral run from 0 to t [Eq. (13.56)]. Thus 


(a + te) u(t)+3u(t) 2 (e* —e*)u(t) + u(t) 
e^! + B&(t) 


Poetae uou (get - ge”) ent 


H 


— ġe u(t) * u(t) + Ze u(t) + Pi 
| — 4e ttu(t) + u(t) + 2e7 u(t) * u(t) 


a 


13.3 Solution of State Equations 809 


Substitution for the above convolution integrals from the convolution table (Table 2.1) 
yields 
re -0 — e7 u(t) + 4a — e™™)u(t) 
e + Bf(t) = 


-4(1 ~e~*)u(t) + 21 — e7”)u(t) 


„jeta S aset) 


e74 ye e *)u(t) 
The sum of the two components (Eq. (13.61a) and Eq. (13.61b)] now gives the desired 


solution for x(t): 


z(t) (3 -3e “+ Be) u(y 
x(t) = | = (13.61¢) 


z2(t) (es + gem)uly 


This result is consistent with the solution obtained by using the frequency-domain method 
[see Eq. (13.36b)]. Once the state variables zı and x2 are found for t > 0, all the remaining 
variables are determined from the output equation. B 


The Output 
The output equation is given by 
y(t) = Cx(t) + Df(t) 

The substitution of the solution for x [Eq. (13.57)] in this equation yields 

y(t) = Cle“'x(0) + e4* x BE(t)) + Df(t) (13.62a) 
Since the elements of B are constants, 

e^t x BE(t) = e®*B + f(t) 

With this result, Eq. (13.62a) becomes 

y(t) = Cle“*x(0) + e4*B « f(t)] + Df(t) (13.62b) 


Now recall that the convolution of f(t) with the unit impulse 6(t) yields f(t). Let us 
define a j x j diagonal matrix 6(t) such that all its diagonal terms are unit impulse 
functions. It is then obvious that 


6(t) * f(t) = f(t) 
and Eq. (13.62b) can be expressed as 


y(t) = Cle“'x(0) + e@*B + £(t)] + D&(t) + f(t) (13.63a) 
= Ce'x(0) + [Ce^™B + D8(t)] + f(t) (13.63b) 


With the notation ¢(t) for et, Eq. (13.63b) may be expressed as 
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y(t)= C(t)x(0) +([Cé(t)B + Dé(t)] » f(t) (13.63c) 
—— y —__eo O 
zero-input response zero-state response 


The zero-state response; that is, the response when x(0) = 0, is 


y(t) = [Cġ(t)B + Dê(t)] * E(t) (13.64a) 
= h(t) * f(t) (13.64b) 

where 
h(t) = C¢(t)B + Dé(t) (13.65) 


The matrix h(t) is a k x j matrix known as the impulse response matrix. The 
reason for this designation is obvious. The ijth element of h(t) is hj;(t), which 
represents the zero-state response y; when the input f;(t) = 6(¢) and when all other 
inputs (and all the initial conditions) are zero. It can also be seen from Eq. (13.39) 
and (13.64b) that 


L£[h(t)] = H(s) 


W Example 13.8 x 
For the system described by Eqs. (13.40a) and (13.40b), determine e°* using Eq. 
(13.59b): 


olt) = e™ = £718) 


This problem was solved earlier with frequency-domain techniques. From Eq. (13.41), 
we have 


+3 i 
GiNeHD (s#1)(s+2) 


o(t) = £7 | H : 
G+1)(s+2) (8+1)(s+2) 


2e7t a et et = et 
Bs +27% et 4 | 
The same result is obtained in Sec. B.6-5 by using Eq. (13.59a) [see Eq. (B.84)]. 
Also, 6(t) is a diagonal j x j or 2 x 2 matrix: 


êt) 0 
0 &(#) 
Substituting the matrices ¢(¢), 6(¢), C, D, and B [Eq. (13.40c)] into Eq. (13.65), we have 


10 Qe-t — e7?” et — e7% 10 6(t) 0 
h(t)=]1 1 | l |+ j A 
2 


—2e7t + 2e? et pe” 11 
3e—* — 2e-7# ete 
= | 6(t)+2e-% enat (13.66) 


—6e~* + 8e? S(t) — Ze" + 4e” 


iè 
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The reader can verify that the transfer-function matrix H(s) in Eq. (13.42) is the Laplace 
transform of the unit-impulse response matrix h(t) in Eq. (13.66). E 


13.4 Linear Transformation of State Vectors 


In Sec. 13.1 we saw that the state of a system can be specified in several ways. 
The sets of all possible state variables must be related—in other words, if we are 
given one set of state variables, we should be able to relate it to any other set. We 
are particularly interested in a linear type of relationship. Let z1, £2, ... , £n and 
W1, W2, ... , Wn be two different sets of state variables specifying the same system. 
Let these sets be related by linear equations as 


w1 = pity + pi2ta + +--+ +pintn 


W2 = pati + poetz2+---+ panty 


(13.67a) 
Wn = Pnit1 + Pn2T2 +`- + Pnnin 
or 
wi Pil P12 ` Pin Ti 
w2 P21 P22 P2n T2 
= (13.67b) 
Wn Pni Pn2 ‘° Pnn In 
w P x 


Defining the vector w and matrix P, as shown above, we can write Eq. (13.67b) as 


w=Px (13.67c) 
and 


x=P-lw (13.67d) 

Thus, the state vector x is transformed into another state vector w through the 
linear transformation in Eq. (13.67c). 

If we know w, we can determine x from Eq. (13.67d), provided that P~! exists. 

This is equivalent to saying that P is a nonsingular matrixt (|P| # 0). Thus, if P 


is a nonsingular matrix, the vector w defined by Eq. (13.67c) is also a state vector. 
Consider the state equation of a system 


x= Ax+Bf (13.684) 
If 
w= Px (13.68b) 
then 
x= Pw 


{This condition is equivalent to saying that all n equations in Eq. (13.67a) are linearly independent; 
that is, none of the n equations can be expressed as a linear combination of the remaining equations. 
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and 
x=P lw 


Hence the state equation (13.68a) now becomes 


P-lw = AP`!w + Bf 


or 
w= PAP w + PBf (13.68c) 
= Âw + Êf (13.68d) 
where 
Â = PAP“! (13.69a) 
and 
Ê = PB (13.69b) 


Equation (13.68d) is a state equation for the same system, but now it is expressed 
in terms of the state vector w. 
The output equation is also modified. Let the original output equation be 


y = Cx+Df 


In terms of the new state variable w, this equation becomes 


y = C(P~!w) + Df 
= Cw+Df 
where 
Ĉĉ = CP} (13.69c) 


@ Example 13.9 
The state equations of a certain system are given by 


tı 0 ilfa 1 
= + f(t) (13.70a) 
t2 —2 -3j | ze 2 
Find the state equations for this system when the new state variables w; and w2 are 


wi = T1 + T2 


w2 = T1 — T2 


Wi 1 1 Tı 
w2 1 -1 T2 


According to Eq. (13.70b), the state equation for the state variable w is given by 
w=Aw+Bf 


or 


where [see Eq. (13.69)] 
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and 


Therefore 
wi —2 0 wi 3 
PERIERE 
we 3-1 w2 -1 


This is the desired state equation for the state vector w. The solution of this equation 
requires a knowledge of the initial state w(0). This can be obtained from the given initial 
state x(0) by using Eq. (13.70b). W 


© Computer Example C13.4 
Solve Example 13.9 using MATLAB. 
A=(0 1;-2 -3]; B=[1; 2]; 
P=[1 1;1 -1]; 
Ahat=P*A*inv(P) 
Bhat=P*B © 


Invariance of Eigenvalues 


We have seen (Sec. 13.3) that the poles of all possible transfer functions of a 
system are the eigenvalues of the matrix A. If we transform a state vector from x 
to w, the variables w1, w2, ... , wn are linear combinations of £1, £2, ... , Zn and 
therefore may be considered as outputs. Hence, the poles of the transfer functions 
relating w1, w2,..., Wn to the various inputs must also be the eigenvalues of matrix 
A. On the other hand, the system is also specified by Eq. (13.68d). This means 
that the poles of the transfer functions must be the eigenvalues of A. Therefore, 
the eigenvalues of matrix A remain unchanged for the linear transformation of 
variables represented by Eq. (13.67), and the eigenvalues of matrix A and matrix 
A(A = PAP~!) are identical, implying that the characteristic equations of A and 
A are also identical. This result also can be proved alternately as follows. 

Consider the matrix P(sI - A)P~!. We have 


P(sI — A)P~) = PsIP~!— PAP“! = sPIP™! - Â = s1- Â 
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Taking the determinants of both sides, we obtain 
|P||sI — A||P~1| = |sI — Â| 
The determinants |P| and |P7}] are reciprocals of each other. Hence 
ls- A] = |sI- Â| (13.71) 
This is the desired result. We have shown that the characteristic equations of A 


and A are identical. Hence the eigenvalues of A and A are identical. 
In Example 13.9, matrix A is given as 


The characteristic equation is 


s -i 
jsI- A| = =s*+3s+2=0 
2 st+3 
Also 
-2 0 
eee 
3 -1 
and 
f s+2 0 
|sI — A] = [-esase=o 
-3 s4+1 


This result verifies that the characteristic equations of A and A are identical. 


13.4-1 Diagonalization of Matrix A 


For several reasons, it is desirable to make matrix A diagonal. If A is not 
diagonal, we can transform the state variables such that the resulting matrix A is 
diagonal. One can show that for any diagonal matrix A, the diagonal elements 
of this matrix must necessarily be \1, A2, ... , An (the eigenvalues) of the matrix. 
Consider the diagonal matrix A: 


a 0 0 0 

0 a 0 0 
A = 

0 0 0 a 


The characteristic equation is given by 


{In this discussion we assume distinct eigenvalues. If the eigenvalues are not distinct, we can 
reduce the matrix to a modified diagonalized (Jordan) form. 
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(s-a) 0 0- 0 
0 (s = a2) 0 0 
|JsI-— A| = =0 
0 0 0 (s — an) 
or 


(s ~ a)(s - a2): -- (s —an) =0 


Hence, the eigenvalues of A are aj, a2, ... , an. The nonzero (diagonal) elements 
of a diagonal matrix are therefore its eigenvalues 41, 2, -.. , An- We shall denote 
the diagonal matrix by a special symbol, A: 


An. 0o0- 0 
0 a Oat 

A= (13.72) 
0 0 Or Hea An 


Let us now consider the transformation of the state vector A such that the resulting 
matrix A is a diagonal matrix A. 
Consider the system 


x=Ax+Bf 


We shall assume that Ay, A2,... , An, the eigenvalues of A, are distinct (no repeated 
roots). Let us transform the state vector x into the new state vector z, using the 
transformation 


z= Px (13.73a) 
Then, after the development of Eq. (13.68c), we have 


ż = PAP 1z+ PBf (13.73b) 


We desire the transformation to be such that PAP! is a diagonal matrix A given 
by Eq. (13.72), or 


z=Az+Bf (13.73c) 
Hence 
A=PAP7! (13.74a) 
or 
AP =PA (13.74b) 


We know A and A. Equation (13.74b) therefore can be solved to determine P. 


E Example 13.10 
Find the diagonalized form of the state equation for the system in Example 13.9. 
In this case, 
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We found A; = —1 and A2 = —2. Hence 


and Eq. (13.74b) becomes 


—1 Of {pn pie Pll pi2 0 1 
0 -24 | poi pee pa pe}||{-2 -3 


Equating the four elements on two sides, we obtain 


—Ppu = —2pie. (13.75a) 
—pi2 = pi — 3pi2 (13.75b) 
—2p21 = —2p22 (13.75¢) 
—2p22 = p21 — 3p22 (13.75d) 


The reader will immediately recognize that Eqs. (13.75a) and (13.75b) are identical. Sim- 
ilarly, Eqs. (13.75c) and (13.75d) are identical. Hence two equations may be discarded, 
leaving us with only two equations [Eqs. (13.75a) and (13.75c)] and four unknowns. This 
observation means there is no unique solution. There is, in fact, an infinite number of so- 
lutions. We can assign any value to p11 and p21 to yield one possible solution. If pi. = kı 
and pai = ke, then from Eqs. (13.75a) and (13.75c) we have p12 = ky /2 and p22 = ke: 


kı a 
P= (13.75e) 
k2 k2 


We may assign any values to kı and kz. For convenience, let kı = 2 and kz = 1. This 


substitution yields 
2 1 
P= (13.75f) 


1 1 
The transformed variables [Eq. (13.73a)] are 
zı 2 1 Ly 241+ 22 
= = (13.76) 
22 1 1 T2 z1 + T2 
Thus, the new state variables zı and zz are related to zı and z2 by Eq. (13.76). The 
system equation with z as the state vector is given by [see Eq. (13.73c)] 


2=Az+Bf 


fIf, however, we want the state equations in diagonalized form, as in Eq. (13.29a), where all 
the elements of B matrix are unity, there is a unique solution. The reason is that the equation 
B = PB, where all the elements of B are unity, imposes additional constraints. In the present 
example, this condition will yield p11 = 3 Piz = q> P21 = 3, and p22 = 3. The relationship 
between z and x is then 


a= hay + fag and 2z2= $21 + dag 
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(a) 


(b) 


Fig. 13.8 Two realizations of the second-order system in Example 13.10. 


where 
A 2 1ıļ]fı 4 
B=PB= = 
Hence 
21 -1 0 zı 4 
= +} |f (13.77a) 
z2 0 -2 z2 3 
or 
ži = =z + 4f 
ig = —2z2 + 3f (13.77b) 


Note the distinctive nature of these state equations. Each state equation involves only one 
variable and therefore can be solved by itself. A general state equation has the derivative of 
one state variable equal to a linear combination of all state variables. Such is not the case 
with the diagonalized matrix A. Each state variable z; is chosen so that it is uncoupled 
from the rest of the variables; hence a system with n eigenvalues is split into n decoupled 
systems, each with an equation of the form 


ži = Àizi + (input terms) 
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This fact also can be readily seen from Fig. 13.8a, which is a realization of the system 
represented by Eq. (13.77). In contrast, consider the original state equations [see Eq. 
13.70a)| 


Š = T2 + f(t) 
t2 = —22 — 3z2 + 2f (t) 


A realization for these equations is shown in Fig. 13.8b. It can be seen from Fig. 13.8a 
that the states zı and z2 are decoupled, whereas the states xı and z2 (Fig. 13.8b) are 
coupled. It should be remembered that Figs. 13.8a and 13.8b are simulations of the same 
system.t W 


©) Computer Example C13.5 
Solve Example 13.10 using MATLAB. 
Caution: The answer for B is not unique. 
A=[0 15-2 -3]; B=[1; 2}; 
[V, L]=eig(A); 
P=inv(V); 
Lambda=P*A*inv(P); 
Bhat=P*B © 


13.5 Controllability and Observability 


Consider a diagonalized state-space description of a system 


ż=Az+ Êf (13.78a) 
and g 

Y = Cz+ Df (13.78b) 
We shall assume that all n eigenvalues à}, A2, ... , An are distinct. The state 


equations (13.78a) are of the form 
dm = Amzm + mifi t+ bmofa + tbmjfy  m=1,2,...n 


If bmi bmt SRO bmj (the mth row in matrix B) are all zero, then 
im = Amm 


and the variable zm is uncontrollable because zm is not connected to any of the 
inputs. Moreover, zm is decoupled from all the remaining (n — 1) state variables 
because of the diagonalized nature of the variables. Hence, there is no direct or 
indirect coupling of zm with any of the inputs, and the system is uncontrollable. In 
contrast, if at least one element in the mth row of B is nonzero, zm is coupled to 
at least one input and is therefore controllable. Thus, a system with a diagonalized 


JHere we only have a simulated state equation; the outputs are not shown. The outputs are 
linear combinations of state variables (and inputs). Hence, the output equation can be easily 
incorporated into these diagrams (see Fig. 13.7). 
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state [Eqs. (13.78)] is completely controllable if and only if the matrix B has no row 
of zero elements. 
The outputs [Eq.(13.78b)} are of the form 


j 
Yi = C4121 + Cigza +--+ Ĉinzn + 5 dimfm 
m=1 

If ĉim = 0, then the state zm will not appear in the expression for y;. Since all the 
states are decoupled because of the diagonalized nature of the equations, the state 
Zm cannot be observed directly or indirectly (through other states) at the output 
yi. Hence the mth mode e™* will not be observed at the output yi. If éim, Cam, -.. 
, Ckm (the mth column in matrix C) are all zero, the state z will not be observable 
at any of the k outputs, and the state zm is unobservable. In contrast, if at least 
one element in the mth column of C is nonzero, zm is observable at least at one 
output. Thus, a system with diagonalized equations of the form in Eqs. (13.78) is 
completely observable if and only if the matrix È has no column of zero elements. 
In the above discussion, we assumed distinct eigenvalues; for repeated eigenvalues, 
the modified criteria can be found in the literature. ! ? 

If the state-space description is not in diagonalized form, it may be converted 
into diagonalized form using the procedure in Example 13.10. It is also possible 
to test for controllability and observability even if the state-space description is in 
undiagonalized form.) + 


@ Example 13.11 


Investigate the controllability and observability of the systems in Figs. 13.9a and 
13.9b. 


s+1 s-1 


Fig. 13.9 Systems for Example 13.11. 


}We can show that a system is completely controllable if and only if the n x nj composite matrix 
{B, AB, A?B,..., A”—18B] has a rank n. Similarly, a system is completely observable if and 
only if the n x nk composite matrix [C’, A/C’, A’?C’, ...., A’™~1C"] has a rank n. 


eS a a a a ee ae 
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In both cases, the state variables are identified as the two integrator outputs, zı and 
x2. The state equations for the system in Fig. 13.9a are 


m=2+f 
t2 = T1 — T2 (13.79) 
and 
y = T1 — 222 
Hence 
1 0 1 
A= » B= , C=[1 -2], D=0 
1 +l 0 
s-l1 0 
[sī — A] = = (s-~1)(s+1) 
- s+1 
Therefore 
à =1 and A2=-1 
and 
1 0 
A= (13.80) 
0 -1 


We shall now use the procedure in Sec. 13.4-1 to diagonalize this system. According to 
Eq. (13.74b), we have 


1 Of [pi pia pu pz| fi 0 
0 -1j {pa p2 pz pzj{1ł1 -1 
The solution of this equation yields 
pz2=0 and — 2p21 = p22 


Choosing pıı = 1 and pa; = 1, we have 


1 0]fi 1 
B=PB= = (13.81a) 
Ladle Ei 


All the rows of B are nonzero. Hence the system is controllable. Also, 


=Cz (13.81b) 


and 


1 077 1 0 
C=cPp"=[1 -a| | =[1 -a| |- 1] (13.81c) 
2 


per 
2 
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The first column of C is zero. Hence the mode zı (corresponding to A; = 1) is unobservable. 
The system is therefore controllable but not observable. We come to the same conclusion 
by realizing the system with the state variables zı and z2, whose state equations are 


According to Eqs. (13.80) and (13.81), we have 


yZaHatsf 
z2=-zo+f 
and 
y= 22 


(a) 


(b) 


Sai 


Fig. 13.10 Equivalent of the systems in Fig. 13.9. 


Figure 13.10a shows a realization of these equations. It is clear that each of the two modes 
is controllable, but the first mode (corresponding to À = 1) is not observable at the output. 
The state equations for the system in Fig. 13.9b are 


Z1=-2it+f 
t2 = —2r1 + £2 + f (13.82) 
and 
y= 22 
Hence 
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st+1 0 
|jsI -— A| = =(s+1)(s—1) 
-1 s- 
so that A1 = —1, à2 = 1, and 
-1 0 
A= (13.83) 
0 1 


Diagonalizing the matrix, we have 
1 Of J pir pre Pil pi2 -1 i 
0 -1] [p2 pee p21 P22 —2 1 
The solution of this equation yields p11 = —pı2 and poz = 0. Choosing pıı = —1 and 


p21 = 1, we obtain 
-1 1 
P= 
1 0 
-1 1 


eP e 


=[1 1] (13.84b) 


and 


¢=cp!=[0 uf 


l1 1 


The first row of B is zero. Hence the second mode (corresponding to Ai = 1) is not 
controllable. However, since none of the columns of C vanish, both modes are observable 
at the output. Hence the system is observable but not controllable. 

We reach to the same conclusion by realizing the system with the state variables zı 
and z2. The two state equations are 


2=Az+Bf 
y= Cz 


From Eqs. (13.83) and (13.84), we have 


AHN 
zg = -22+ f 
and thus 
y =z +z2 (13.85) 


Figure 13.10b shows a realization of these equations. Clearly, each of the two modes is 
observable at the output, but the mode corresponding to A1 = 1 is not controllable. E 


© Computer Example C13.6 
Solve Example 13.11 using MATLAB. 


A=[1 0;1 -1]; B={1; 0]; C=[1 -2]; 
ÍV, L]=eig(A); 
P=inv(V); 


ea a ee en ee ee a 
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Ahat=P*A*inv(P); 
Bhat=P*B 
Chat=C*inv(P) © 


13.5-1 inadequacy of the Transfer Function Description of a System 


Example 13.11 demonstrates the inadequacy of the transfer function to describe 
an LTI system in general. The systems in Figs. 13.9a and 13.9b both have the same 


transfer function j 


stl 


Yet the two systems are very different. Their true nature is revealed in Figs. 13.10a 
and 13.10b, respectively. Both the systems are unstable, but their transfer function 
H(s) = sti does not give any hint of it. The system in Fig. 13.9a appears stable 
from the external terminals, but it is internally unstable. The system in Fig. 13.9b, 
on the other hand, will show instability at the external terminals, but its transfer 
function H(s) = + is silent about it. The system in Fig. 13.9a is controllable but 
not observable, whereas the system in Fig. 13.9b is observable but not controllable. 

The transfer function description of a system looks at a system only from the 
input and output terminals. Consequently, the transfer description can specify only 
the part of the system which is coupled to the input and the output terminals. 
Figures 13.10a and 13.10b show that in both cases only a part of the system that 
has a transfer function H (s) = st is coupled to the input and the output terminals. 
This is the reason why both systems have the same transfer function H(s) = + 

The state variable description (Eqs. 13.79 and 13.82), on the other hand, con- 
tains all the information about these systems to describe them completely. The 
reason is that the state variable description is an internal description, not the ex- 
ternal description obtained from the system behavior at external terminals. 

Mathematically, the reason the transfer function fails to describe these systems 
completely is the fact that their transfer function has a common factor s — 1 in 
the numerator and denominator; this common factor is canceled out with a conse- 
quent loss of the information about these systems. Such a situation occurs when 
a system is uncontrollable and/or unobservable. If a system is both controllable 
and observable (which is the case with most of the practical systems) the transfer 
function describes the system completely. In such a case the internal and external 
descriptions are equivalent. 


H(s)= 


13.6 State-Space Analysis of Discrete-Time Systems 


We have shown that an nth-order differential equation can be expressed in 
terms of n first-order differential equations. In the following analogous procedure, 
we show that an nth-order difference equation can be expressed in terms of n first- 
order difference equations. 

Consider the z-transfer function 


me + bm—1z7" 1 tere t biz + bo 


[z] : 
Hjz 
2% +an_y2™-14---+ayz + ao 


(13.86a) 
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Fig. 13.11 Controller canonical realization of an nth-order discrete-time system. 


The input f[k] and the output y[k] of this system are related by the difference 
equation 


(E” +an-1E"7} +--+ +a,E + ao)ylk] = 
(bmE™ + bm 1E™ 1 +---+b1E +bo)flk]  (13.86b) 


The controller canonical realization of this equation is illustrated in Fig. 13.11. 
Signals appearing at the outputs of n delay elements are denoted by 2;{k], z2[k], 

. » Zn{k]. The input of the first delay is snk +1]. We can now write n equations, 
one at the input of each delay: 


zıfk + 1] = z2fk] 
xo{k + 1] = z3fk] 


NEETA ATA (13.87) 
tn—ilk + 1] = enlk] 
an[k +1] = ~ao71[k] — arzafk] — --- — an-ızn[k] + f [k] 
and 
y(k) = bozi (k) +biza(k) +- + bmtm4i(k) (13.88) 


Equations (13.87) are n first-order difference equations in n variables x1(k), z2(k), 

. , Zn(k). These variables should immediately be recognized as state variables, 
since the specification of the initial values of these variables in Fig. 13.11 will 
uniquely determine the response y{k] for a given f[k]. Thus, Eqs. (13.87) repre- 
sent the state equations, and Eq. (13.88) is the output equation. In matrix form we 
can write these equations as 


lemme am a 
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zilk +1] Ow By Wi ete 09 0 zalk] 0 
z[k +1] 0o HOt PE ats, 1G 0 zalk} 0 
= + fIk] 
Zn-1Ík + 1] 0 0 0°- 0 1 In—1[k] 0 
Znl[k +1] —a9 —@1 —a2 `- ~Qn_2 ~GQn-1 Ek] 1 
—_-_ ES 
x[k+1] A x[k] B 
(13.89a) 
and 
xı[k] 
x2fk] 
ylk] = [bo bi -> bm] (13.89b) 
X , : 
c 
k 
In general, tml] 
x(k + 1] = Ax[k] + BEfk] (13.90a) 
ylk] = Cx[k] + Dffk] (13.90b) 


Here we have represented a discrete-time system with state equations in controller 
canonical form. There are several other possible representations, as discussed in 
Sec. 13.2. We may, for example, realize the system by using a series, parallel, or 
observer canonical form. In all cases, the output of each delay element qualifies as 
a state variable. We then write the equation at the input of each delay element. 
The n equations thus obtained are the n state equations. 


13.6-1 Solution in State-Space 
Consider the state equation 
x(k + 1] = Ax{k] + Bffk] (13.91) 


From this equation it follows that 


x|k] = Ax(k — 1] + Bf[k — 1] (13.92a) 

and 
x(k — 1] = Ax{k — 2] + Bffk — 2] (13.92b) 
x[k — 2] = Ax{k — 3] + Bffk — 3] (13.92c) 


x{1] = Ax[0] + Bf[0] 


Substituting Eq. (13.92b) in Eq. (13.92a), we obtain 
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x(k] = A®x[k — 2] + ABf[k — 2] + Bffk — 1] 
Substituting Eq. (13.92c) in this equation, we obtain 
x{k}] = A®x{k — 3] + A?Bffk — 3] + ABfjk - 2] + Bfk — 1] 
Continuing in this way, we obtain 
x(k] = A*x(o] + A*~!Beffo] + A¥-?Bf[1] + --- + Bffk — 1] 
k-1 
= A*x(0] + $ A‘) BE] (13.93) 
j=0 


The upper limit on the summation in Eq. (13.93a) is nonnegative. Hence k > 1, 
and the summation is recognized as the convolution sum 


A*-lulk — 1] + Bffk] 


Hence 
x[k] = A*x[0] + A*~tu[k — 1] « Bffk] (13.93b) 
S02 —_—_—XKx=¥-veveyesse” 
zero-input zero-state 
and 
y(k] = Cx + Df 
k-1 : 
= CA*x(0] + $` CA‘! YBAIj] + Df (13.94a) 
j=0 
= CA*x/[0] + CA*®-ufk — 1] « Bflk] + Df (13.94b) 


In Sec. B.6-5, we showed that 


AF = Bol + Bi A + BoA? +--+ Bn- A”? (13.95a) 


where (assuming n distinct eigenvalues of A) 


Bo TALA et AITANT Ak 
By 1 àz AB ano ak 
= (13.95b) 
Bn-1 VN XE. eee AR ak 
and ài, A2, ..- , An are the n eigenvalues of A. 


We can also determine A* from the z-transform formula, which will be derived 
later in Eq. (13.102): 


AF = Z“H(I - zA) (13.95c) 
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| Example 13.12 

Give a state-space description of the system in Fig. 13.12. Find the output y[k] if the 
input f[k] = uk] and the initial conditions are xı[0}] = 2 and z2{0] = 3. 

The state equations are [see Eq. (13.89)] 


zilk +1] 0 1] [2:[k] 0 
Z +| of (13.96a) 
aE E 


an 
21 [k] 
y{k] =[-1 5] (13.96b) 
x2[k] 
To find the solution [Eq. (13.94)], we must first determine A*. The characteristic equation 
of A is 
A -1 
|AI— Al = =x- a+ = (a3) (0-5) = 
2 y_s 6 3 2 
6 6 
Hence, A1 = i and Az = 4 are the eigenvalues of A and [see Eq. (13.95)] 


A" = Boi +A 
where [see Eq. (B.95b)] 


Bo 1 47r 3-2) [(3)"* 3(3)7* — 2(2)-* 
Wee / ee | et ena 


1 0 0 1 
A* = [3(3)~* — 2(2)"*] | + {-6(3)~* + 6(2)*] | 
0 1 -4 


and 


Doka 


pa -2(2)7F —6(3)-* + a 
= (13.97) 


(3)-* — (2)~* = -2(3)7* +. 3(2)7* 


We can now determine the state vector x[k] from Eq. (13.93b). Since we are interested in 
the output y[k], we shall use Eq. (13.94b) directly. Note that 
CA‘ =[-1 5] A* = [2(3)-* — 3(2)-* = —4(3)-* +. 9(2)-*] (13.98) 


and the zero-input response is CA*x(0], with 


Hence, the zero-input response is 
CA*x[0] = —8(3)—* + 21(2)-* (13.99a) 


The zero-state component is given by the convolution sum of CA*—'u[k — 1] and Bffk}. 
Using the shifting property of the convolution sum [Eq. (9.46)], we can obtain the zero- 
state component by finding the convolution sum of CA*u[k] and Bf{k] and then replacing 
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Sik 


Fig. 13.12 System for Example 13.12. 


k with k — 1 in the result. We use this procedure because the convolution sums are listed 
in Table 9.1 for functions of the type f[k]u[k] rather than f[k}ufk — 1]. 


0 
CA*ulk] * BF [k] = [2(3)-* — 3(2)7* —4(3)7* + 9(2)-*] x | 
ujk] 
= —4(3)~* « ufk] + 9(2)~* + u[k] 


Using Table 9.1 (Pair 2a), we obtain 


— 37(k+)) — 97(k+1) 
CA*u{k] + Bf[k] = —4 H] ulk] +9 Ee ulk] 
3 2 


= [12 + 6(37 ®t) — 18(27 FF yale] 
Now the desired (zero-state) response is obtained by replacing k by k — 1. Hence 


CA*u(k] + Bs[k — 1] = [12 + 6(3)~* — 18(2)*Ju{k — 1] (13.99b) 
It follows that 
ylk] = [-8(3)~* + 21(2)~*u[k] + [12 + 6(3)~* — 18(2)*Jufk — 1] (13.100a) 


This is the desired answer. We can simplify this answer by observing that 12 + 6(3)—* — 
18(2)—* = 0 for k = 0. Hence, u{k — 1] may be replaced by u[k] in Eq. (13.99b), and 


ylk] = [12 — 2(3)~* + 3(2) "Jur (13.100b) 
E 


© Computer Example C13.7 
Solve Example 13.12 using MATLAB. 


A=[0 1;-1/6 5/6]; B=[0; 1]; C=[-1 5]; D=0; 
x0=([2;3]; 

k=0:25; 

u=ones(1,26); 

ly,x]=dlsim(A,B,C,D,u,x0); 

stem(k,y) 
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© Computer Example C13.8 
Using MATLAB find the zero-state response of the system in Example 13.12. 
A=[0 1;-1/6 5/6]; B=[0; 1]; C=[-1 5]; D=0; 
{num,den]=ss2tf(A,B,C,D); 
k=0:25; 
u=ones(1:length(k)); 
y=filter(num,den,u); 
stem(k,y) © 


13.6-2 The Z-Transform Solution 
The z-transform of Eq. (13.91) is given by 


zX[z] — zx[0] = AX[z] + BF[z] 


Therefore 
(z1 — A)X[z]) = zx[0] + BF[z] 
and 
X(z] = (z1 — A)~!2x[0] + (zI — A) BF{z] 
= (I — z71A)7!x[0] + (zI - A)“'BF[z] (13.101a) 
Hence 
x(k] = ZT [(I — 271A) 4]x[0] + 271 [(2I — A)`'BF[z]] (13.101b) 
zero-input component zero-state component 


A comparison of Eq. (13.101b) with Eq. (13.93b) shows that 
Af = 271-27 A)7}] (13.102) 
The output equation is given by 


Y{z] = CX[z] + DF[z] 
= C[(I — 271A)7?x(0] + (21 — A)? BF[z]] + DF[z] 


= C(I — z7'A)~!x{0] + [C(zI — A)“'B + DJF [2] (13.103a) 
=C(I—27'A)-!x0}+  H[2]F[z] 
zero-input response zero-state response 
where 
H[z] = C(zI —- A~1)B+D (13.103b) 


Note that H[z] is the transfer function matrix of the system, and H;,[z], the ijth 
element of H[z], is the transfer function relating the output y;(k) to the input f;(k). 
If we define hfk] as 


blk] = 27" [H[z]] 
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then hfk] represents the unit impulse function response matrix of the system. Thus, 
hij[k]; the ijth element of h(k), represents the zero-state response y;(k) when the 
input f;(k) = 6[k] and all other inputs are zero. 


@ Example 13.13 


Using the z-transform, find the response y[k] for the system in Example 13.12. 
According to Eq. (13.103a) 


1 -2 ]71[2 z -1]"[ 0 
PN d aa Le 


z(6z-5 


z 
= Er | 
6z2—5z+1 arm 2 (2-1)(2?- $24 §) 
=[-l +[-1 5] 
-z 6z? 22 
6z2—5z+1 622-5242 G-I- $248) 
132? — 3z (5z — 1)z 
22-8242 0 (z-1)(2?- 22+2) 
—8 21 12z 12z 6z 18z 
= +5 + beek Seem 
z-4 z-5 2 1 oz Bag BS 


Therefore 
ylk] = [-8(3)~* + 21(2)7* + 12 + 6(3)-* — 18(2)* Jule] a 
ee ed 


zero-input response zero-state response 


Linear Transformation, Controllability, and Observability 


The procedure for linear transformation is parallel to that in the continuous- 
time case (Sec. 13.4). If w is the transformed-state vector given by 
w= Px 
then 
wik + 1] = PAP~'w[k] + PBf 
and 


ylk] = (CP')w + Df 


Controllability and observability may be investigated by diagonalizing the matrix. 


13.7 Summary 


An nth-order system can be described in terms of n key variables—the state 
variables of the system. The state variables are not unique, but can be selected 
in a variety of ways. Every possible system output can be expressed as a linear 
combination of the state variables and the inputs. Therefore the state variables 
describe the entire system, not merely the relationship between certain input(s) and 
output(s). For this reason, the state variable description is an internal description 
of the system. Such a description is therefore the most general system description, 
and it contains the information of the external descriptions, such as the impulse 
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response and the transfer function. State-variable description can also be extended 
to time-varying parameter systems and nonlinear systems. An external system 
description may not describe a system completely. 


The state equations of a system can be written directly from the knowledge 
of the system structure, from the system equations, or from the block diagram 
representation of the system. State equations consist of a set of n first-order differ- 
ential equations and can be solved by time-domain or frequency-domain (transform) 
methods. Because a set of state variables is not unique, we can have a variety of 
state-space descriptions of the same system. It is possible to transform one given 
set of state variables into another by a linear transformation. Using such a trans- 
formation, we can see clearly which of the system states are controllable and which 
are observable. 
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Problems 


13.1-1 Convert each of the following second-order differential equations into a set of two 
first-order differential equations (state equations). State which of the sets represent 
nonlinear equations. 


(a) ¥+ 109+ 2y = f 
(b) 74+ 2e%y + logy =f 
(c) H+ dily)y + ga(y)y = f 


2 


Ree 32 


Fig. P13.2-1 


13.2-1 Write the state equations for the RLC network in Fig. P13.2-1. 

13.2-2 Write the state and output equations for the network in Fig. P13.2-2. 

13.2-3 Write the state and output equations for the network in Fig. P13.2-3. 

13.2-4 Write the state and output equations for the electrical network in Fig. P13.2-4. 
13.2-5 Write the state and output equations for the network in Fig. P13.2-5. 


832 


13.2-6 
13.2-7 
13.2-8 


13.2-9 


13.3-1 
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13 Q 1Q 


Fig. P13.2-2 


Fig. P13.2-3 Fig. P13.2-4 


Fig. P13.2-5 Fig. P13.2-6 


Write the state and output equations of the system shown in Fig. P13.2-6. 
Write the state and output equations of the system shown in Fig. P13.2-7. 


Write the different sets of state equations (two canonical, series, and parallel forms) 
and the output equation for a system having a transfer function 


3s+ 10 
H(s) = 277412 
Repeat Problem 13.2-8 if 
E E E S 
~ (s+ 1)(s + 2)? ~ (s + 1)3(s + 2) 


Find the state vector x(t) using the Laplace transform method if 


x=Ax+Bf 


Problems 833 


13.3-2 


13.3-3 


13.3-4 


13.3-5 


SANS UE WAR CER AR RR EEKEREN 


N 
; 
È 
è 
Pra 
: 
: Fig. P13.2-7 
> 
» 


dda a AAR 


PP Lie Lol PIE PP OE ELELLA 


SRNR SANS RR RR RRA ARRAN RR 


“ 0 2 0 2 
= and = x(0) = an = 
aa e = 00 


Repeat Prob. 13.3-1 if 


-5 -6 1 5 
A= i J s= f o= f and f(t)= sin 100¢ 


Repeat Prob. 13.3-1 if 


—2 0 1 0 
A= : 4 s= wf" and f(t) = u(t) 


Repeat Prob. 13.3-1 if 


p i f i 1 u(t) 
A= B= x(0) = f= 
0 -2 0 1 A al 


Using the Laplace transform method, find the response y if 


where 


x = Ax + Bf(t) 
y = Cx + Df(t) 
where 
—3 1 1 
A= B= C={0 1) D=0 
~2 0 0 
and 


2 
f(t) = u(t) x(0) = | | 
0 


834 


13.3-6 


13.3-7 


13.3-8 
13.3-9 
13.3-10 


13.3-11 
13.3-12 
13.3-13 
13.3-14 
13.3-15 
13.3-16 
13.3-17 


13.3-18 
13.3-19 
13.4-1 
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Repeat Prob. 13.3-5 if 


2 
F(t) =u)  x(0)= "| 


The transfer function H(s) in Prob. 13.2-8 is realized as a cascade of Hı (s) followed 
by H2(s), where 


3s +10 
og %4 ee ae 


Let the outputs of these subsystems be state variables xı and x2, respectively. Write 


the state equations and the output equation for this system and verify that H(s) = 
C¢(s)B+D. 


Find the transfer-function matrix H(s) for the system in Prob. 13.3-5. 


Hi(s) = 


Find the transfer-function matrix H(s) for the system in Prob. 13.3-6. 


Find the transfer-function matrix H(s) for the system 


x=Ax+Bf 
y=Cx+Df 
where 
0 1 0 1 f(t) 
A= B= f= 
-1 -2 1 0 falt) 
1 2 0 0 
C=ļ|4 1 D=]0 0 
1 1 1 0 


Repeat Prob. 13.3-1, using the time-domain method. 
Repeat Prob. 13.3-2, using the time-domain method. 
Repeat Prob. 13.3-3, using the time-domain method. 
Repeat Prob. 13.3-4, using the time-domain method. 
Repeat Prob. 13.3-5, using the time-domain method. 
Repeat Prob. 13.3-6, using the time-domain method. 


Find the unit impulse response matrix h(t) for the system in Prob. 13.3-7, using Eq. 
(13.65). 


Find the unit impulse response matrix h(t) for the system in Prob. 13.3-6. 
Find the unit impulse response matrix h(t) for the system in Prob. 13.3-10. 
The state equations of a certain system are given as 


tı =22+2f 


t2 =-z1 -T2 +f 


Problems 835 


13.4-2 


13.4-3 


13.4-4 


Define a new state vector w such that 


wi = T? 
w2 = T2 — Ti 
Find the state equations of the system with w as the state vector. Determine the 


characteristic roots (eigenvalues) of the matrix A in the original and the transformed 
state equations. 


The state equations of a certain system are 
tı = 22 
t2 = -221 — 3224+ 2f 
(a) Determine a new state vector w (in terms of vector x) such that the resulting 


state equations are in diagonalized form. 
(b) If the output y is given by 


y=Cx+Df 
where 
11 
C= and D=0 
-1 2 


determine the output y in terms of the new state vector w. 


Given a system 
0 1 0 0 
x=/0 0 IL}x+]O0/f 
0 -2 -3 1 


determine a new state vector w such that the state equations are diagonalized. 


The state equations of a certain system are given in diagonalized form as 


—1 0 0 1 
x=] 0 -3 o0jfjx+ļ|il7f 

0 0 -2 1 
The output equation is given by 

y={1 3 1]x 
Determine the output y if 

1 

x(0) = | 2 and f(t) = u(t) 


1 
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13.5-1 


13.6-1 


13.6-2 


13 State-Space Analysis 


Fig. P13.5-1 


Write the state equations for the systems depicted in Fig. P13.5-1. Determine a new 
state vector w such that the resulting state equations are in diagonalized form. Write 
the output y in terms of w. Determine in each case whether the system is controllable 
and observable. 


An LTI discrete-time system is specified by 


2 0 0 
a=] e-|"| C=[0 1] and D=[I] 
11 1 


and 


2 
oef] om ieee 


(a) Find the output y[k], using the time-domain method. 
(b) Find the output y(k], using the frequency-domain method. 


An LTI discrete-time system is specified by the difference equation 
ylk + 2] + y[k + 1] + 0.16y[k] = f[k + 1] + 0.32f[k] 
(a) Show the two canonical, series and parallel realizations of this system. 


(b) Write the state and the output equations from these realizations, using the 
output of each delay element as a state variable. 


13.6-3 Repeat Problem 13.6-1 if 


ylk + 2] + y[k + 1] — 6y[k] = 2f[k + 2] + f[k + 1] 
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The following books are listed for readers desiring alternate treatment of topics 
covered in this book. 
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Englewood Cliffs, N.J., 1985. 


Carlson, G.E., Signal and Linear System Analysis, Houghton Mifflin Co., 
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York, 1989. 


Gabel, R.A., and R.A. Roberts, Signals and Linear Systems, 3rd ed., Wiley, 
New York, 1987. 


Glisson, T.H., Introduction to System Analysis, McGraw-Hill, New York, 1985. 


Jackson, L.B., Signals, Systems, and Transforms, Addison Wesley, Boston, 
Mass, 1991. 


Kamen, E., and B.S. Heck, Fundamentals of Signals and System, Prentice-Hall, 
Englewood Cliffs, N.J., 1997. 


Kwakernaak, H., and R. Sivan, Modern Signals and Systems, Prentice-Hall, 
Englewood Cliffs, N.J., 1991. 


Mayhan, Robert J., Discrete-time and Continuous-time Linear Systems, Ad- 
dison Wesley, Reading, Mass, 1984. 
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Answers to Selected Problems 
A i a ee 


Chapter 1 


1.1-1 (a), (b), and (c) m (d) 4m 1.1-4 Py = P_yz = 64/7, Paf = 256/7, Pog = 64c?/7 

1.1-6 (a) 50 (b) 178 (c) 51 (d) 25 (e) 25 (f) 1/2. 

1.4-2 fi(t) = (4t+1)u(t+1)—6tu(t)+3u(t)+(2t—4)u(t—2), fo(t) = t?u(t)—(t?—2¢+8)u(t—2)—(2t-8)u(t—4) 
1.4-4 (a)0 (b) $5(w) (c) 4t) (d) -25(t~1) (e) zô +3) (f) kô(w) 

1.4-5 (a), (b) f(t) (c)1 (a) 0 (e) 20.085 (f)5 (g) f(—1) (h) -7.389 

1.4-11 (a) +73 (b) -3+343 (c)2+33 (d)-2 (e)2 (f) 0. 

1.7-1 Only (b), (f) and (h) are linear 1.7-2 Only (a) and (f) are time-invariant. 

1.7-3 y(t) = [e—(t+5) + 2(¢ + 5)e— (t+) +2] u(t +5) — [e705 + 2(t — 5)e-(t-8) +2] u(t—5) 

1.7-7 (a) Causal (b) Noncausal (c) Noncausal (d) Noncausal. 

1.8-1 (D +3)yi(t) = f(t), (D +3)y2(t)= Df(t) 1.8-3 go(t) = preult), (D +a)h(t) = 4q: (t) 


Chapter 2 


2.2-1 (a) A? +5A+6, A? +5A+6=0, —2, —3, and e72, e73t (b) 5e—2# — 3e73t 
2.3-2 S(t) + (e7? +e™3t)u(t) 2.3-4 (2+ 3t)e—3tu(t) 
2.4-5 (a) tu(t) (b) te*u(t) (c) }t?u(t) 2.4-6 (a) (1— cost)u(t) (b) sin tu(t) 
2.4-8 (a) (2-26-34 Le-)u(t) (b) (e7 — e~3#)u(t) (c) [(2 — t)e~?* — 2e-3#]u(t) 
2.4-10 (a) qlo.555 — e™?t cos(3t + 123.7°)Ju(t) (b) 4fe-? — Fee cos(3t + 71.56° )Ju(t) 
24-11 (a) (ef —e7**)u(t) (b) e8(e“# —e-**)u(t)— (c) e-ĉje7(t-3) — e~2(t-3))u(t — 3) 
(d) (1—e7*)u(é) - [1 —e~@-Dju(t—1) 2.4-13 tan™lt+ z 
2.4-15 1- cost for 0 < t < 2m, cost — 1 for 2r < t < 4r, 0 otherwise. 2.4-21 H(s) = eT. 
2.5-1 (a) je% — tet 4+1 (b) jet — eit 4 de-* (c) e73t— ett 
2.5-3 (a) (44+ 5t)e7?t—2e73t (b) (24+42t)e-2* 2.5-4 -łe 424 2.5-5 (2—t)e-3t—2¢~4t 
2.6-2 (a) Asympt. stable (b) marginally stable (c) unstable (d) marginally stable. 
2.6-3 (a)O (b) marginally stable (c) BIBO unstable 2.7-1 (a) No (b) Yes 
2.7-2 Width 0.6 ms, maximum rate 1667 pulses/sec. 2.7-3 (a) 1074 (b) 104Hz (c) 104 pulses/sec. 


Chapter 3 


3.1-2 (a) c=0.5 (b) Ee = 1/12 3.2-1 Cn; = Cng =0, cng =~1, ny = V2/0 

3.41 (a) f)=F+4 eae cy cosnat 

3.4-3 (a) wo = 7/2, ap = 0, bn = 0 and an = $ sin(nr/2) (c) wo = 1, a9 = 0.5, an == 0 and bn = ~ 4 
(f) wo = 1/3, ao = 0.5, bn = 0 and an = <tr (cos( 22) — cos( 28%) 

3.4-4 (a) wo = 2, ap = 0.504, an = 0.504(7- 257) and bn = ~—0.504( 88-5 

3.4-7 (a) wo = 7/4, ag = 0, an = atin (8F sin 3% — 1) and bn = why sin 2 

3.4-9 All except (c) and (e) are periodic. Periods (a) 2x (b) 2m (d) 2 (f) 140% (g) 87/3 (h) 2x (i) x. 


3.4-11 f(t) ~ rolt) — ja (t) — ġza(t) —- bar(t) 3.4-12 f(t) = -2t + hie = i) ow 
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3.5-1 


3.5-5 


4.1-5 
4.1-6 
4.3-2 
4.3-3 
4.3-6 
4.3-7 
4.4-3 
4.5-1 
4.6-5 
4.7-5 
4.8-4 


5.1-2 
5.1-4 
5.1-6 
5.1-8 
5.1-9 
5.2-3 


6.1-1 
6.1-2 
6.1-3 


6.2-1 
6.2-3 
6.2-4 
6.3-1 
6.3-2 
6.3-3 
6.3-4 
6.3-5 
6.3-7 


Answers to Selected problems 


(b) wo = 1/5, Dn = ay sin(n7/5) (d) wo = 2, Do = 0, Dn = -4 sin( =) — cos( %7) 

(e) wo = 27/3, Do = 1/6, and Dn = 5-3-5 [e~J27™"/3(28 4 1) - 1] 

N=3 35-6 N=6 35-7 N=2 3.61 y(t)=) 0° vo Te 

Chapter 4 

(a) Ante Joe lM 

; E (b) sint+sin 2t 4.2-4 (a) “2sinc[wo(t —to)] (b) Locosunt 
= 2e73 (cos etu sinw- 2, Fs(w) = perm e732) 

K 4 sin?(“Z) S nerie (c) intense (a) GHAT 4.35 jAsinc(w)sin 3w 

(a) 5 {sinc? [e72] + sinc? [9] } (c) [sinc r(w + 10) + sinc m(w — 10)Je—72"” 

(a) 2sinc(t)cos4t 4.4-1 (a) (e~t—e7?*)u(t) (c) de7*tu(t)+ de¢u(—t) (d) (1—e*)u(t) 

(d) Bandwidths of yı (t), y2(t) and y(t) are 10 kHz, 5 kHz, and 15 kHz, respectively. 

to ~3V2k 4.5-2 to 40s 4.5-3 All unrealizable. (a) tg = 1 psec. (b) tg © 100 psec. 

B= 9.368 Hz. 4.7-2 (a)Yes (c) minimum wc = 2r B (d)No (e) Works only for even n. 

(a) A =20,(b) A=10, (c) A=5 4.8-3 Bry = 42 kHz, Bpm = 38.06366 kHz. 

AF = 100 Hz, B= 2.2 kHz 4.8-5 AF = 20 kHz, B= 42 kHz. 


(b) Žr (coswr +wrsinwt — 1) 


Chapter 5 


(a), (b) 200 Hz (c) 120 Hz (d) 150 Hz 5.1-3 The signal recoverable only in cases (b) and (c). 
(a) h(t) =u(t)—u(t—1) 5.1-5 (b) Hw) =T sinc? (= T) (c) Minimum delay= T 

F(w) = 0.2F(w) +4 3 > ae sinc (22) F(w — 5007). 

(a) 30 kHz (b) 16 bits (c) 480,000 bits/s (d) 705,600 bits/s 

(a) 10.8 MHz (b) 10 bits (c) 108 Mbits/s 5.2-1 No = 512, zero padding required. 


No = 256, T = 0.03125 by both criteria. 5.2-4 (a) No = 16, T = 0.625 (b) No = 8, T = 1.25 
Chapter 6 


-s 2 wg? s { sO~—S5sine 

(a) z(1~e ) (0) EES (e) Al ra + sE (w i-o] (8) s7 = (h) zt asta 
a = 1—e-*—se-%) (b) HE (c) 4(1-e78 — pet) + sere (+0) 
atti es 

(b) 3.018e7?t aan 34°)u(t) (c) 6(t)+(3.2e3*~—0.2e-%*)u(t) (g) fe~*-(14+t4+ & = pte = = Je-24u(t) 
(h) [z — į4(1 - 2t)e™? + ¥10 9-2 cos(t + 71.56°)}u(t) 
(0) == E (d ) eae (e) reais e7 (str (g) Wo cos ror wot (h) wo cos sor WOT ost 
(b) V2e~(t-3) cos(t 3+ 4)u(t—3)+2e~* sintu(t) (c) [elt sin 2(t — 1)Ju(t — 1) + Zet sin 2tu(t) 


s 


(b) Ai 
(a) (et -e~t juft) (b) (24 6t)e~**u(t) (c) 24+ 5.836e~% cos(4t — 99.86°)u(t) 
The zi & zs comps. are: (b) (2+5t)e~#, te~* (c) V/2e~3* cos(4t— 4), 245.154e—3* cos(4t—112.83°) 
(a) m(t) = (3 - fet — de-**) u(t), y2(t) = (4 - fet + het u(t) 

yi(t) = [(8 + 17.8915 cos($ — 26.56°)}u(t), y2(t) = 20V2e—! 5* cos($ — F)u(t) 

(a) htt 63-6 (a) (D?+3D + 8)ylt) = (D +5)f(t) 

(iii) (1.5e72(t-5) — 2e-3(t-5) + 0.5e74lt-5))u(t — 5) (iv) e?? (1.5e7 — 2e73t +0.5e74)u(t) 

(v) e720(1.5e72(t-5) — 2e-3(t-5) + 0.5e74lt-5))u(t — 5) 


Answers to Selected problems 841 


6.3-9 
6.4-3 
6.4-5 
6.4-6 
6.7-1b 
6.7-2 
6.8-1 
6.8-2 
6.8-3 
6.8-4 


6.8-5 


7.1-1 
7.1-2 
7.5-1 
7.6-2 
7.7-2 
7.7-4 


8.2-2 
8.2-4 
8.2-7 
8.2-9 
8.3-2 
8.3-4 
8.4-4 


9.1-4 
9.2-2 
9.3-1 
9.3-5 
9.4-1 
9.4-4 
9.4-7 


4 [e bap pee ee u(t) 6.4-1 (tet — de-tsint)u(t) 6.4-2 (5 — We-2/3)u(t) 


O) ráni O) pout) oda mal) = (4 pet- ketul) galt) = (2 Fert deal 
yi(t) = 7.787e7t/6 tie —31.1°)u(t), vs(t) = 226(t) + [10 + 9.045¢~*/6 cos( ft — 152.2°)u(t) 
40e~*/Su(t) 6.4-7 1.716e~?# cos(3t + 29°)u(t) 6.4-8 (121.61e76-53t — 1. 61e—2-8t)u(t) 

PO = 3%, tr = 1.15 secs., ts = 2.67 secs., es = 0, er = 0.75, ep — 

Kı = 2, Ko = 25.4, a = 6.128 6.7-3 t, cannot be satisfied. 6.7-5 No. 

(a) No region of convergence (b) -1<Res<0O (c) Res=0 (d) -1<Res<0O (e) alls 
(a) 2; IResi<1 (c0) poji 1<Res<2 (f) motets 0<Res<1 

D) a(t) cult) (E) (ete? )ult) (I) ette Ayalaa (e) (ete ult) ea) 
(a) (e~t — et + 2e~7*)u(t) (b) (—e7* + et — 2e7?*)u(—t) 

(c) (e~* + 2e7*)u(t) + efu(—t) (d) 2e~ u(t) + (-e7* + e*)u(—t) 

(a) [—$e-t + 2e-*/2]u(t) + Zet/2u(—t) (d) ([ġe7t + 4eJu(t) + detu(—t) (f) infinite 


Chapter 7 


(a) V2 cos(2t — 15°) (b) 2/2sin 2t (c) 2.28 a — 12.12°) 
(a) 7.5u(t) (b) MB cos(2t + 3. 69°)u(t) (b) MB sin(3t — 112.62°)u(t) (c) MIB gi(3t— —67.62° a(t) 


Ze 106 > 1.002 x 102° 
H(s) = s37200e7420,000e¢108 7-5-3 H(s) = $442,615 x 10% s343.418 x 101052 +2,618% 109 s+1.002x 1020 


x 4.9x10° Z s5 
H(s) = 53498.8572 +12380s+491,300 7.7-1 H(s)= syan 452.484 +137583+22,284524+223,1925+1,117,708 


3 4 2 
= s 2.255 x 1048 
A(s) = 8° +59.05s2+942.81s+419,079.42 7.7-3  H(s) = 314212.433472,550s2 +5. aly 1055+6. 25% 108 


= 2.241045? (9?+1200)? 
A(s) = 84 164.759 +74,8178"4.117x 100s+6.25% 108 7.7-5 H(s)= 5 +56.5335 +399.857+67,824s+1.44x10 


Chapter 8 


(a), (b)(-3)* (c)(—e)* (d)(—e)* 8.2-3 Aperiodic: (b) & (c); Periodic: (a) No = 4 & (d) No = 6. 
(c) Periodic; No = 20 . 8.2-5 Qy and [Qf are (b) —0.87, 0.8% (c) 0.6168, 0.6168 (e) 0.97, 0.97 
(a) ej(0-27k+8) (b) ej0k — 3 (c) ej4333k (q) ejl-3tk 8.2-8 (a) and (b) 2.7778 (c) 2.7778c? 
(a) 19 (b) 19 (c) 252 (d) 40 8.2-10 (a)1 (b)1 (c) 0.5 (d) 0.5 (e) 0.5 8.2-11 (a) 3 (b) Zz 
10 cos (0.9rk — 4) and 5cos(0.9rk — Z) 8.3-3 10cos (Fk) + VI0cos ($5 k — 1.107) 

(i)1500 Hz (ii) 1500 Hz (iii) de (iv) 1500 Hz (v) 2000 Hz. (vi) 600 Hz 

(a) f{k] = (k +3) (ulk + 3] — ufk]) + (—k + 3) (ufk] —u[k—4]) 8.5-2 p[k -+ 1] — 1.02p[k] = 1.01; [k] 


Chapter 9 


—12,36 and -63 9.1-5 —5, 7.667, and —5.445 

~(B+2k)\(-1)F 9.2-3 2(V2)¥ cos(Ẹk) 9.2-4 yew l2" (0.5)* — (0.5) (2)*] 
0.56[k] — 0.5(—2)Fufk] 9.3-4 2.061(5)* cos(0.923k — 0.244)u[k] 

(b) 36[k] — 56[k — 1] — 26[k — 3) 

geqile GF) — (—2)*+}ulk] 9.4-3 [F (3) — (2E — 3 (—5)*+ ula] 

lB) — (2)* + 5k(2)*Jufk] 9.4-5  Jo[(3)* +4 cos[$(k + 1) — 2.261] + 0.637(2)*+ 1} ufh] 
(a) 3[(2)**? — (0.5)***}ufa] (b) $ {(2)k+? — (0.5)F+2]ulk] (c) $(2*-? — (0.5)F-Hufk — 2) 


842 Answers to Selected problems 


9.4-8 50000[(1.01)*+! — t}u[k] — 1500(1.01)*~4u[k — 4] 9.410 N = 23, residual pmt $471.2 
9.5-1 ai [2e(-2)F +e] 9.5-2 zrl (-2)t +e7*] 9.5-3 (b) (=F — (2) + 38) 
9.5-4 (334 2k)(-1)*- $ (8)7F 9.5-6 0.241(0.2)* — 0.377(0.8)* + 0.765 cos( ZE — 1.393) 


9.6-1 (a) Asympt. stable (b) marginally stable (c) unstable (d) unstable (e) marginally stable. 
Chapter 10 


10.1-1 2ej0-4Tk 4 ej(0-8rk+7/2) 4 ej(1-2rk-7/2) 4 2ej1-6rk 
10.1-2 A fei0-Smk 4 ej0-9rk 4 ejl-1nk 4 ejl-5xk] 10.1-3 ej(0-8rk+1.6r) 4 oj(1.2xk-1.62) 


10.1-4 No = 1/3, No = 6, Dr = £[3 + 4cos(Zr) + 2cos(2#r)} 


10.2-1 (a) 1 (b) e“I®ko (c) —2— (d ze 10.2-2 (b) e733%(3 + 4cosQ + 2cos 22 
eita a{e? —a) 


919-7102 -j2 


10.2-8 4sinc?(Z#) 10.3-1 (a) ET 10.3-2 (a) gtm (b) pee 

10.4-1 (a) fik] = }sinc?(SE) (b) Fon) = $ E, AC), Fal) = 1/4 (0) FO) = 2A(72). 

10.5-1  [2(-0.5)* — 8(-0.8)* + 2(—0.2)*}ufk] 10.5-3 [—(0.5)* + $(0.8)]u[k] + $(2)Fuf—(k + 1)] 

10.6-1 The 3-point DFT is F} = 8, Fz = e$, Fy =e 33. F(Q) = 3e3% 4+342e-I%. (c) The 8-point DFT 
is 8, 6.5355 + j0.707, 3+ j, —0.5355 + 70.707, —2, —0.5355 — 70.707, 3 — j, 6.5355 — 50.707. 

10.6-3 The 1-point DFT is Fo = 1 and F(Q)=1 (c) The No-point DFT is 1, 1, , ---, 1, 1. 

10.6-4 (a) The No-point DFT is No, 0, 0, 0, ---, 0,0, FO) = SEEP. 

10.6-7 (a) The 5-point response is 9, 12, 16, 83. (b) The Periodic Convolution is 17, 15, 16. 

10.6-8 The 6-point response is 3, 8, 14, 9, 5,3 10.6-9 The output y[k] is 1, —1, 1, 3, -1,1,--- 


Chapter 11 


111-3 (b) —25{k] + ((2)* — $(3)*]ufk] (d) (3 — 7(2)* + 3(3)* afk] (e) (3(—1)* — 3(2)* + 2k(2)*} ula] 
G) [F + V2(6)* cos(3# — 3 )jufk] (k) (1 — 3(2)* — 3 (2)* + 3k(k — 1)(2)* ula} 

111-4 2,-1,and4 11.2-2 sata or tas taz" tg 43a 42e 

11.2-3 (a) BEEP (b) EHEH (o) -H @) iie + mz) 

11.3-3 [$ + 8(2)-*— 4(4)-*}ufk] 11.3-4 [$ - $(4)-* - F (2)*]ufk] 

11.3-8 [0.318(e)* — 0.367(V2)* cos(3%k — 0.525)]u[k] 11.3-9 [1.32(e)¥ — 0.186(—0.2)* — 1.13(0.8)*}u[k] 

11.3-11 (a) 12[47* + 3(2)7* — 4(3)~*]ujk] (b) 1247-2 + 3(2) 7-2 — 4(3)7*-2]u[k — 2] 
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Chapter 12 RJA ¥ 
hj 1 j2) -1;_ sin ee $ 
(a) HS] = reram Hl?) = -tan e oal PS n 
jQ)) 12.24—10.8 cos Q 1/2 iQ) a tan~ 1 3sin29-1.8sinQ 5 at 
(c) HIS] = lapase=3 Giese sram]? LH[e!] = tan [Pe a ae a7 K se 


tanie] 12.1-2 (a) [Hei] = 4cos 2 + cos 38 + 2cos 52, ZH[ei9) = -2.50 


(a) HS = (APSERESRA)?, LHe] = tan- (aioa) — tan ERGs) 
(b) 2.86 cos (0.5k — 1.6725) 12.1-5 (a) Fh = hp = ate = 10 kHz. (b) Fs > 2F, = 100 kHz, 


UB a _ 0.187 — 1.707(1-a?—~V2a)(2?- 3241) 
T< =10ps. 12.2-2 (c) BW = SB Hz 12.2-3 A[z| = a aiai 2 
= — [0.0314162(z—0.97474) 
(a) For T = 7/350, H[z] = [ zZ2—1.93832+0.9391 ] 
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(a) H[z] = 225} (b) |H[e%T} = 2) tan $T] (d) T = 25 ps. 
— __0.09057(z+1)? _ __0,0512(z+1)? 3 0.3203(z—1)? 
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Hiz] = 0.04235(z—1) ER 0.4175(z? —1.4712z+1) 
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H[z] = 2 aay z2-* (k odd), Huamlz] = 2 > ae: t (0 54 + 0.46 cos 2% #) pk 
h[k] = + [—0.2885, 0.3140, —0.3779, 0.5282, —1.0137, 0, 1.0137, —0.5282, 0.3779, —0.3140, 0.2885]. 
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(a) #1 = 22, t2 = —27; — l0zr2 + f (b) a1 = x2, 2 = —2e*1 z2 — logz1 + f (nonlinear) (c)¢1 = 
T2, £2 = —$1(r1)x2 — P2(x1)z1 + f (nonlinear). 

tı = —3z1—å2+ f, 2 = -r1 -fr2+8f 13.2-3 2) = —5r1+z2+5f1, 2 = ~2e1—2x242f,—-2fo 
ii = -m1+$+Å, y=-z1+f 13.2-6 ż1 = —102) +522, 2 = —2e2—23+f, #3 = 11—83, Y = £1 
tı = A121, 2 = À2T2 + fi, t3 = À3T3 + fo, t4 = Agra + fo, Yi = x1 + T2, Y2 = T2 + T3 
Controller Canonical: żı = 22, 2 = —12z1 — 7z2 + f, y = 1021 +372, Observer canonical: zı = 
—7z1+£2+3f, 2 = —1221+10f, y = zı Series: 2) = —4r1ı —9r2+10r2+3f, t2 = —3r2+ f, Y = £1 
Parallel: 1 = —421 + f, t2 = —3z1 + f, y = 221 +22 
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Active circuit analysis, 406 
Additivity property, 79 
Aliasing (spectral folding), 327, 338, 346, 347, 
557, 734, 735, 740, 742 
Amplitude modulation, 260, 277-289 
DSB-SC, 277 
SSB-SC, 286 
Amplitude response, 472, 717 
Amplitude spectrum, 194, 239, 619, 628 
Analog signals, 58 
Analog systems, 87 
Analog to digital (A/D) conversion, 58, 332 
Angle modulation, 289 
bandwidth of, 296 
demodulation of, 299 
generation of, 298 
instantaneous frequency of, 291 
narrowband, 297 
wideband, 297 Anti-aliasing filter, 327 
Anticausal signal, 59, 449 
Aperiodic signals, 58 
Asymptotically stable system, 148, 603 
Autocorrelation function, 182 


Bandwidth, 212, 248 
essential, 276, 737 
of angle modulated signals, 296 
Bhaskar, 4 
Bilateral Laplace transform, 362, 449 
Bilateral z-transform, 659-662, 668, 704 
Bilinear transformation, 740 
prewarping inherent in, 743 
simplified design procedure, 748 
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choice of sampling interval T in, 742 
Binary code, 332 
Bit (binary digit), 332 
Block diagrams, 411 
Block filtering, 655 
overlap and add method, 655 
overlap and save method, 658 
Bode plots, 477 
Bocher, M., 206 
Bombelli, Raphael, 4 
Bounded-input, bounded-output (BIBO) 
stability, 152, 608 
Break (corner) frequency, 481 
Butterworth filter, 501, 505-513, 
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Carrier, 260, 277 
Causal signal, 59 
Causal systems, 84 
Cayley-Hamilton theorem, 42 
Characteristic equation, 43, 107, 579, 804 
Characteristic modes, 107, 579 
Characteristic polynomial, 43, 107, 579 
Characteristic roots 107, 579, 804 
complex, 108, 579 
repeated, 107, 149, 579, 604 
Characteristic value, 107, 579, 804 
Charge coupled device (CCD), 567 
Complete set, 184, 185 
Complex frequency, 73 
Complex frequency plane, 73 
Complex numbers, 1 
algebra of, 4 
arithmetical operations of, 11 
origins of, 2 
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Continuous-time system, 87 
forced response of, 139, 140 
frequency response of, 471 
Laplace-transform analysis of, 365, 394 
natural response of, 139, 140 
realization of, 414 
stability of, 148 
state equations of, 788 
time-domain analysis of, 104, 804 
transfer function of, 394 
zero-input response of, 80, 106, 392 
zero-state response of, 80, 118, 392 
Control systems, 426 
analysis of, 429, 434 
design specifications of, 433 
error constants in, 443 
stability considerations in, 448 
Controllability, 93, 818, 830 
Convolution, 120 
circular (or periodic), 349, 644, 651 
graphical understanding of, 127 
properties of, 121 
Table of, 125 
Convolution sum, 587, 366, 683 
graphical procedure of, 592 
properties of, 587 
sliding tape algorithm of, 594 
Table of, 590 
Corner (break) frequency, 481 
Correlation, 177 
application to signal detection , 179 
coefficient , 177 
convolution, comparison with, 182 
functions, 181 
Cramer’s rule, 22 
Cubic equation solution, 3, 49 


Data truncation, 300, 340 

Damping ratio, 434 

Decimation (downsampling), 561 
Decimation-in-frequency algorithm, 356 
Decimation-in-time algorithm, 353 
Decomposition property, 80, 105 
Deconvolution, 615 

Demodulation 
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of AM, 284 
of angle modulated signals, 299 
of double sideband (DSB-SC), 280 
of single sideband (SSB-SC), 286 
Diagonal matrix, 35 
Difference equation, 564, 573 
classical solution of, 598 
z-transform solution of, 685 
iterative solution of, 574 
time-domain solution of, 578 
Decibel, 478 
Differential equation, 104 
time-domain solution of, 106 
classical solution of, 139 
Laplace transform solution of, 394 
Differentiation table, 49 
Digital communication, 332 
Digital filters, 541, 567, 716, 729 
advantages of, 567 
nonrecursive, 574n, 756 
recursive, 574n, 729 
Digital signals, 58 
Dirichlet conditions, 195, 240 
Discrete Fourier transform (DFT), 217, 340, 
643 
properties of, 347, 643 
Discrete-time Fourier series (DTFS), 617 
Discrete-time Fourier transform (DTFT), 627 
properties of, 633 
Discrete-time signal, 57, 617 
Discrete-time sinusoid, 546 
highest rate of oscillation of, 555 
nonuniqueness of, 550 
peculiarities of, 547 
periodicity condition in, 548 
reduced frequency of, 551 
Discrete-time systems, 87, 573, 668 
forced response of, 597, 598 
frequency response of, 716 
natural response of, 597, 598 
realization of, 693 
stability of, 603 
state equations of, 823 
time-domain analysis of, 573 
transfer function of, 372 
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z-transform analysis of, 353 
zero-input response of, 578, 689 
zero-state response of, 213 
Distortionless transmission, 268 
Distributed-parameter system, 87 
Downsampling (decimation), 561 
Duality property of the Fourier transform, 253 
Dynamic systems, 84 
Dynamical equation, 787 


Eigenvalues, 42, 107 

invariance of, 813 

of a matrix, 42, 804 
Energy signals, 60 
Energy spectral density, 275 
Envelope detector, 284 
Equal ripple functions, 515 
Error constants in control systems, 443 
Essential bandwidth, 276, 737 
Euler formula, 6, 19 
Even function, 75 
Everlasting exponential, 73, 249 
Exponential Fourier series, 206 
External description of a system, 92 


Fast Fourier transform (FFT), 217, 352 
Feedback systems, 426 
negative, 429, 448 
positive, 429, 448 
Filters 
allpass 535 
bandpass, 501, 505, 526, 725, 752 
bandstop (notch), 502, 505, 531, 727, 752, 
Bessel Thomson, 535 
Butterworth, 501, 505 
Chebyshev, 501, 514 
elliptic, 523 
frequency sampling, 771 
frequency transformations in, 524 
highpass, 503, 505, 524, 725, 750 
ideal, 270 
inverse Chebyshev, 522 
lowpass, 500, 505, 725 
nonrecursive, 730, 756, 761, 771 
recursive, 729, 734, 740 
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passband of, 504 
stopband of, 504 


Final value theorem, 410, 685 
Finality property of Fourier coefficients, 186 
First-order hold, 324, 358 
Folding frequency, 327, 558 
Forced response, 139, 140, 597, 598 
Fourier, Jean-Baptiste-Joseph, 187 
Fourier integral, 237, 627 
Fourier series, 185, 189, 206 
Dirichlet conditions for, 194, 195 
exponential, 206 
generalized, 185 
symmetry conditions in, 198 
trigonometric, 189 
Fourier spectra 
of continuous-time Fourier transform, 239 
of discrete-time Fourier series, 619 
of exponential, 208 
trigonometric, 194 
Fourier transform, 240, 627 
duality (symmetry) property of, 235 
existence of, 239 
frequency-convolution property of, 263, 
634 
frequency-shifting property of, 259 
linearity of, 240 
numerical computation of, 338 
physical appreciation of, 240 
scaling property of, 255 
Table of, 252 
time convolution property of, 263 
time differentiation property of, 264 
time integration property of, 264 
time shifting property of, 257 
Frequency division multiplexing (FDM), 300 
Frequency-domain analysis, 
of continuous-time systems, 243, 244, 361, 
365 
of discrete-time systems, 660, 668 
of state equations, 811, 829 
Frequency modulation, 289 
Frequency resolution, 340, 343 
Frequency response, 471, 716 
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Frequency sampling filters, 771 

Frequency shift keying (FSK), 295 

Frequency-shifting property, 259, 349, 385 
634, 644 

Frequency spectra, 194, 239, 619, 627 

Fundamental frequency, 189, 551 

Fundamental frequency range, 551 
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Gain crossover frequency, 491 
Gate function, rect(t), 245 
bandwidth of, 248 
Generalized Fourier series, 185 
Gauss, Kar! Friedrich, 3 
Generalized function, 71 
Gibbs phenomenon, 205, 765 
Gibbs, Willard, 204, 205 


Half-wave (rotational) symmetry, 199, 230 
Hamming window, 304, 305, 766, 769 
Hanning (Von Hann) window, 304 
Harmonic frequency, 189 

Heaviside, Oliver, 379 

Homogeneity property, 79 

Hybrid (sampled-data) systems, 697 


Ideal filters, 270, 
Impulse function, 69 
sampling (sifting) property of, 71 
Impulse invariance method, 734 
Impulse response, 115, 120, 137, 263, 390, 583, 
587 
Impulse response matrix, 810 
Information transmission rate, 158 
Initial conditions, 78, 111, 142, 392, 574, 688 
Initial condition generators, 400 
Initial state, 785 
Initial value theorem, 410, 685 
Input, 77 
Instantaneous frequency, 290 
Instantaneous (memoriless) systems, 84 
Integral control, 447 
Integration table 48 
Interpolation, 323, 561 
first-order hold, 324, 358 
ideal, 324 


simple (zero-order hold), 323, 358 
Inverse discrete Fourier transform, 341 
Inverse Fourier transform, 238 
Inverse Laplace transform, 364 
Inverse z-transform, 661, 669 
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Iterative solution of difference equation, 574 


Lag compensator in control systems, 447 
Laplace, Marquis Pierre-Simon, 379 
Laplace transform, 361 

abscissa of convergence of, 369 

bilateral, 361, 449 

existence of, 369 


frequency-convolution property of, 388 


frequency-shifting property of, 385 
inverse, 364, 371 
linearity property of, 365 
physical interpretation of, 365 
region of convergence, 366, 367, 451 
scaling property of, 388 
Table of, 372 
time convolution property of, 388 
time differentiation property of, 385 
time integration property of, 387 
time shifting property of, 382 
unilateral, 367 
Lead compensator in contro] systems, 446 
Leakage, 303, 340 
Left half plane (LHP), 74 
Legendre polynomials, 187, 232 
L’H6pital’s rule, 46 
Linear system, 79 
Log magnitude, 478 
Lower sidebands, 278 
Linear time-invariant system, 83 
Lumped-parameter system, 87 


Maclaurin series, 46 
Marginally stable system, 148, 396, 603 
Matrix, 34 
algebra of, 36 
characteristic equation of, 43, 804 
derivative and integral of, 41 
eigenvalues of, 42, 803 
identity, 35 
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impulse response, 810 

nonsingular, 40 

state transition, 807 
Maximally flat response, 506, 534 
Mean-squared error, 53 
Memoriless system, 84 
Michelson, Albert, 205 
Modified z-transform, 703 
Modulation, 260, 277, 289 
Multiplexing 

frequency-division, 262, 301 

time-division, 331 


Natural frequencies, 107 
Narrowband angle modulation, 297 
Natural response, 139, 140, 597, 598 
Noncausal system, 84 

approximate realization of, 86 
Nonrecursive filter, 730, 761, 771 
Normal form equations, 787 
Null function, 368n 
Numerical computation of Fourier coefficients, 

216 

Nyquist interval, 321 
Nyquist plot, 491 
Nyquist rate of sampling, 321 


Observability, 93, 818, 830 
Odd function, 75 
Operational amplifier, 406, 422 
Operators, 

advance, 577 

differential, 89 
Orthogonal signal set, 183 
Orthogonal vector set, 183 
Orthogonality, in complex signals, 175 
Orthogonality in real signals, 174 
Orthonormal set, 184 
Output, 77 
Output equation, 786 


Paley-Wiener criterion, 271 
Parseval’s theorem 
for Fourier series, 186, 214 
for Fourier transform, 275 
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for discrete-time Fourier series 664 
for discrete-time Fourier transform 635 
Partial fraction expansion, 24, 371, 675 
modified, 33 
Passband of a filter, 504 
Peak time, 431 
Percent overshoot, 431 
Period of a continuous-time periodic signal, 15, 
59, 200 
Period of a discrete-time periodic signal, 548 
Periodic signal, continuous-time, 58, 
Periodic signal, discrete-time, 548 
Periodicity condition in discrete-time signals, 
548 
Phase crossover frequency, 491 
Phase-locked loop (PLL), 299 
Phase modulation, 289 
Phase response, 268, 472, 717 
Phase shift keying (PSK), 295 
Phase spectrum, 194, 239, 619, 628 
Picket fence effect, 340 
Polar plot, 491 
Power signals, 60 
Position error constant, 443 
Probabilistic signals, 60 
Pulse amplitude modulation (PAM), 331 
Pulse code modulation (PCM), 332 
Pulse dispersion, 158 
Pulse position modulation (PPM), 331 
Pulse width modulation (PWM), 331 
Pythagoras, 2 


Quadratic equation solution, 49 
Quantizing, 332 


Random signals, 60 

Rectangular window, 302, 305, 650, 763, 

Recursive filter, 729, 734, 740 

Regenerative repeater, 334 

Region of convergence, 362, 366, 367, 451, 670, 
704 

Right half plane (RHP), 74 

Rise time, 156, 431 

Rolloff rate, 303 

Root locus, 438, 439 


INDEX 


Sallen-Key circuit, 408 
Sampled-data (hybrid) systems, 697 
Sampling (sifting) property of impulse func- 
tion, 71 
Sampling rate (frequency), 321, 558 
Sampling theorem, 319 
applications of, 331 
dual of, 336 
Scaling property, 255, 388 
Sidebands 
double, 277 
lower, 278 
single, 286 
upper, 278 
Sidelobes, 303 
Signals 
analog, 58 
aperiodic, 59 
comparison of, 177 
continuous-time, 57 
detection of, 179 
digital, 58 
discrete-time, 57 
distortion during transmission of, 268 
energy, 60 
energy of, 52, 274, 556 
essential bandwidth of, 276, 276n 
periodic, 58 
power, 60 
power of, 52 
representation by orthogonal basis signals 
of, 183 
size of, 52 
Signum (sign) function, sgn(t), 251 
Sinc function, 246 
Single sideband signals 
generation of, 288 
demodulation of, 286 
Sinusoids, continuous-time 14 
Sinusoids, discrete-time, 546 
Spectral folding (aliasing), 327, 338, 346, 347, 
557, 734, 735, 740, 742 
Stability of a system, 147, 396, 603 
asymptotic, 148, 396, 603 
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bounded-input, bounded-output (BIBO), 
152, 608 
marginal, 148, 396, 603 
State equations, 784, 824 
derivation from transfer function of, 791 
frequency-domain solution of, 799 
of electrical circuits, 788 
time-domain solution of, 804, 825 
State transition matrix, 807 
computation of, 807 
State variables, 784 
selection of, for electrical networks, 788 
State vector, 788 
linear transformation of, 811 
Steady-state error, 431, 441 
Steady-state response, 476, 717 
Stopband of a filter, 504 
Strip of convergence, 451 
Superposition principle, 79 
Surface acoustic wave (SAW) devices, 567 
Symmetry conditions in Fourier series, 198, 
213, 230 
Systems, 77 
block-diagram of, 411 
causal, 84 
characteristic equation of, 43, 107, 579 
classification of, 79 
closed-loop, 427 
continuous-time, 87, 235, 361 
control, 426 
discrete-time, 87, 562, 573, 668 
distributed-parameter, 87 
dynamic, 84 
external description of, 92 
feedback, 426 
finite memory, 84 
frequency response of, 471, 716 
instantaneous, 84 
internal description of, 92 
linear, 79 
lumped parameters, 87 
marginally stable, 148, 396, 603 
memoriless, 84 
model of 88 
negative feedback, 429, 448 
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observable, 93, 818, 830 
overdamped, 432 
positive feedback, 429, 448 
realization of, 414, 693, 791, 798 
response to sinusoidal inputs, 471, 716 
rise time of, 156 
stability, 147, 603 
state equations of, 788, 825 
time constant of, 158 
time-domain analysis of, 104, 573 
time-invariant, 83 
time-varying parameters, 83 
transform analysis of, 361, 668 
type 0, 444 
type 1, 443 
type 2, 444 
type q, 444 
underdamped, 432 
unstable, 148, 603 

System realization, 414, 693 
canonical form, 414, 457 
cascade form, 419 
parallel form, 419 
repeated poles, 421 


Taylor series, 46 
Time constant, 154, 156, 158 
Time-differentiation property, 264, 385 
Time-division multiplexing (TDM), 331 
Time-domain analysis, 
of continuous-time systems, 104 
of discrete-time systems, 573 
of state equations, 804, 825 
Time integration property, 264, 387 
Time-invariant system, 83 
Time inversion, 65, 560 
Time scaling property, 255, 388, 561 
Time shifting, 61 
Time shifting property, 257, 349, 382, 560, 634, 
644 
Time-varying parameter system, 83 
Transfer function, 138, 396 
Transfer function matrix, 802 
Triangle function A(t), 245 
Triangular (Bartlett) window function, 302, 
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305, 762 
Trigonometric Fourier series, 189 
compact form, 190 
Trigonometric identities, 47 


Underdamped system, 432 

Unilateral Laplace transform, 367 

Unilateral z-transform, 670 

Unit impulse function, 69 

Unit impulse response of a system, 115, 263, 
390, 583 

Unstable system, 148, 603 

Upsampling (interpolation), 561 


Vectors, 34, 171, 183 
Velocity error constant, 443 
Voltage controlled oscillator (VCO), 298 


Width property of convolution, 122, 136, 588 
Wideband angle modulation, 297 
Window functions, 302, 305, 762 

Blackman, 305 

Hamming, 304, 305, 762 

Hanning, 304, 305, 762 

Kaiser, 305 

rectangular, 302, 305, 762 

triangular, 302, 305, 762 


Zero-input response, 80, 106, 391, 578, 800, 826 
Zero order hold (ZOH), 323, 358, 698 
Zero padding, 343, 647 
Zero-state response, 80, 118, 394, 585, 689, 800, 
826 
z-transform, 659, 668 
bilateral, 659, 668, 704 
convolution property of, 683 
existence of, 671 
inverse, 673, 678 
left shift property of, 681 
linearity property of, 669 
modified, 703 
region of convergence of, 670 
right shift property of, 680 
Table of, 674 
Unilateral, 670 


